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INSTRUCTIONAL  SYSTEMS  DEVELOPMENT 


PHASE  I ; ANALYZE 


ill-  juiaiiiiiaiiiij^ 


BLOCK  I.l:  ^'•/*'.YZE  JOB 


OVERVIEW 

Development  of  an  instructional  program  is  begun  because  no  training 
program  has  been  found  to  exist  that  is  capable  of  adequately  training 
individuals  to  do  a particular  job.  This  first  step  in  the  ISD  process, 
then,  is  to  establish  exactly  what  constitutes,  or  will  constitute, 
adequate  on-th'^-job  performance.  It  answers  the  questions  of  what 
tasks,  performed  in  what  manner,  under  what  conditions,  in  response  to 
what  cues,  to  what  standards  of  performance,  make  up  the  job.  Regard- 
less of  how  well  the  next  steps  are  carried  out,  if  job  analysis  data 
are  not  valid  and  reliable,  the  resulting  instructional  program  will 
fail  to  produce  personnel  able  to  perform  their  duties  at  an  acceptable 
level . 


ANALYZE  JOB 


].0  INTRODUCTION 

1.1  How  An  Instructional  Systems  Cev&lcpiTicnt  Program  Begins 

Where  a particular  Instructional  Systems  Development  (ISD)  program 
begins  depends  on  what  has  been  done  before.  For  example,  if  you  or 
someone  else  recently  completed  an  adequate  Job  analysis  of  the  par- 
ticular job  for  which  you  intend  to  provide  an  ISD  training  program, 
you  should  not.  begin  with  this  block.  While  this  is  an  excellent 
point  at  which  to  begin  learning  about  ISD,  it  Is  not  necessarily  the 
point  at  which  you  would  begin  developing  an  ISD  program. 

The  ultimate  purpose  of  ISD  is  to  produce  a properly  trained  per- 
son; tha.  is,  a person  who  can  do  the  job  for  which  he  was  trained. 
This  means  that  in  order  to  design  and  carry  out  effective  training 
you  first  must  know  the  job  in  considerable  detail.  The  ISD  process 
begins  with  specific  questions  about  the  job. 

Some  of  the  things  you  must  find  out  about  the  job  in  order  to 
develop  adequate  training  are: 

1.  'Vhat  kinds  of  people  will  be  doing  this  job?  How  many 
will  be  doing  the  job?  Where  will  they  be  located? 

2.  What  major  duties  does  the  job  include? 

3.  What  tasks  make  up  the  job? 

Exactly  how  is  each  task  accomplished?  What  work  elements 
make  up  the  task?  In  what  order  must  these  be  performed? 
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5.  Under  what  conditions  «Rist  each  task  be  perfonnedT  Idiat 
tools,  equipment,  or  other  facilities  are  required 

to  perform  each  task? 

6.  What  cues  cause  a job  inomkient  (job  holder),  in  the  job 
situation,  to  perform  a particular  task  in  a particular 
manner?  (How  does  he  knoa  when  to  start  a task,  when  to 
perform  each  element  that  makes  up  the  task,  and  when  the 
task  is  con^leted?) 

7.  To  what  standard  of  proficiency  must  each  task  be  performed? 

Requirements  for  trained  people  originate  from  a number  of  sources: 

1 , Introduction  of  new  weapons  and  systems 

2,  New  laws,  Department  of  Defense  (DOO)  requirements,  military 
service  specific  needs,  and  social  problems 

3.  Realignment  of  career  fields,  ratings.  Military  Occupational 

Specialties  (MOS),  or  Air  Force  Specialties  (NOTE:  Hereafter, 

when  referring  to  specialties  in  all  services,  the  term  Defense 
Occupational  Specialty  (DOS)  will  be  used.) 

4.  Quality  control  reports  indicating  a training  need  that  is  not 
being  adequately  met 

Hfiile  training  needs  can  and  will  arise  from  any  and  all  of  these 
sources,  the  first  step  in  the  ISO  process  is  to  identify  the  discrepancy 
that  exists  between  whatever  training  is  being  given  at  the  present  time 
and  the  training  that  must  be  given  to  satisfy  the  manpower  need.  Dis- 
covery of  this  discrepancy  begins  by  asking  the  question:  Does  anyone 
do  the  job  now? 
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If  the  answer  is  "yes,"  a second  question  is:  Is  there  now  a 
training  progran  for  this  job? 

If  the  answer  to  both  questions  is  "yes,"  you  will  have  to  look 
further  to  discover  the  discrepancy.  Further  questions  and  procedures 
are  outlined  In  Block  1.4:  ANALYZE  EXISTING  COURSES.  These  will  assist 
you  in  determining  the  exact  location  of  the  discrepancy  in  the  existing 
training  program.  In  the  ISO  model,  finding  the  first  discrepancy  indi- 
cates only  where  you  should  begin.  Finding  and  correcting  the  first 
discrepancy  probably  will  not  result  in  an  acceptable  training  program, 
but  instead  most  likely  will  require  a series  of  changes  that  will  affect 
every  part  of  the  program. 

If  the  answer  to  both  questions  is  "yes,"  you  should  begin  the 
actual  ISO  process  at  Block  1.4;  ANALYZE  EXISTING  COURSES.  However,  the 
ISO  approach  to  analyzing  existing  courses  requires  a clear  understanding 
of  the  steps  outlined  in  Blocks  I.l,  1.2,  and  1.3.  Therefore,  unless  you 
are  certain  you  already  have  that  clear  understanding,  the  best  place  to 
begin  learning  about  the  ISO  process  is  here  in  Block  I.l. 

If  the  answer  is  "no"  to  either  of  the  above  questions  (that  is, 
if  no  one  does  the  job  now  or  no  training  programs  for  the  job  exist), 
you  have  found  the  discrepancy.  In  the  first  case,  where  no  one  does 
the  job  now,  the  job  undoubtedly  is  just  being  erected  because  of  some 
new  or  modified  system  or  equipment.  A discrepancy  is  certain  to  exist 
between  the  ability  of  existing  courses  to  effectively  and  efficiently 
train  personnel,  and  the  training  requirements  of  an  as  yet  undefined 
new  job.  In  the  second  case,  where  there  is  no  existing  training  program, 
there  is  certain  to  be  a discrepancy  between  the  ability  of  a non-existent 
course  to  provide  adequate  training  and  the  training  requirements  of 
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either  e new  or  existing  job.  Therefore,  the  correct  place  to  begin  in 
the  ISO  process  is  to  ana1y2e  the  job  to  determine  exactly  what  the  job 
holder  fwst  do  when  he  does  the  Job  right.  This  is  the  foundation  for 
all  sound  training  prograre.  If  this  step  is  not  done  and  done  well, 
there  wil.l  be  no  basis  for  development  of  effective,  efficient  instruction. 
Some  of  the  outputs  of  this  block  are: 

1.  A validated  list  of  tasks  that  make  up  the  particular  job 
being  analyzed. 

2.  Conditions  under  which  each  task  must  be  performed,  cues 
that  initiate  performance  of  the  task,  and  standards 

to  which  each  task  rmist  be  performed. 

3.  Details  of  how  each  task  is  performed;  that  is,  a listing 
of  the  work  elements  that  make  up  each  task. 


In  the  next  block.  Block  1.2:  SELECT  TASKS/FUNCTIONS,  a decision 
will  be  made  as  to  which  tasks  will  be  trained  and  which  tasks  will  not 
be  trained.  In  Block  1.3;  CONSTRUCT  JOB  PERFORMANCE  MEASURES,  Job 
Performance  Measures  (JPM)  will  be  developed  to  determine  whether  someone 
is  capable  of  doing  the  job.  This  step  may  require  inputs  from  some  of 
the  same  people  who  provided  inputs  in  one  or  both  of  the  two  preceding 
blocks.  These  facts  lead  to  critical  questions; 

1.  Why  waste  time  and  money  in  Block  I.J  ^tting  information  on 
conditions,  standards,  and  elements  for  tasks  that,  in  Block 
1.2,  you  may  decide  not  to  train? 


2.  If  you  have  to  make  a long,  expensive  trip  to  get  job  information 
in  Block  I.l,  why  make  the  same  trip  again  in  Block  1.3?  Why 
not  get  alj^  the  information  while  you  are  there? 
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3.  Sines  you  probably  Mill  use  a questionnaire  to  validate  your 
task  list  In  Block  I.l,  and  since  you  also  will  use  a question- 
naire Mith  basically  the  same  people  to  gather  Information  for 
making  the  selection  decision  In  Block  1.2,  why  not  do  both  with 
the  sans  questionnaire? 

A single  answer  should  satisfy  aV'i  of  the  above  questions.  Lie  order 
In  which  you  carry  out  the  steps  outlined  In  Blocks  I.l,  1.2,  and  1.3 
depends  largely  on  the  type  of  job  analysis  you  Intend  using  and  on 
economic  considerations.  Certainly  you  cannot  develop  Job  Performance 
Measures  for  tasks  sel.  .ted  for  training  until  you  select  tasks  for 
training.  Nor  can  you  select  tasks  for  training  until  you  know  what 
the  tasks  are  from  which  you  are  to  choose.  Other  than  such  obvious, 
logical  restrictions,  the  ISO  process  does  not  restrict  you  to  a specific 
job  analysis-approach  or  to  a specific  sequence  of  steps  in  carrying  out 
the  requirements  of  the  first  three  blocks  in  the  model.  The  only 
requirement  is  that  your  approach  be  well-planned,  logical,  and  consistent 
with  the  needs  and  resources  of  your  command. 

1,2  Pefinition  of  Job  Analysis  Terms 

Already  in  this  introduction,  we  have  used  some  terms  that  many  people 
use  to  mean  diffeient  things.  It  is  essential  that  those  involved  in 
ISO  define  such  terms  as  job,  duty,  task,  and  element  in  the  same  way. 

Since  one  of  the  purposes  of  analyzing  jobs  is  to  provide  information  for 
developing  instruction,  there  nwst  be  clear  communication  between  the  ones 
who  analyze  the  job  and  the  ones  who  use  the  job  analyst's  findings  as  a 
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basis  for  developing  instruction.  Because  of  this,  we  will  spend  some 
time  here  defining  job  analysis  terns  and  pointing  out  how  the  terms 
can  be  effectively  used  to  describe  exactly  what  a person  does  when  he 
does  his  particular  Job  ri^ht.  Figure  1.1  illustrates  the  relationship 
betwu'en  the  several  layers  of  a job  breakdown.  Further  examples  will 
be  given  later  in  this  section. 


1 

1 
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FIGUR6I.1:  Interrelationships  of  Job,  Duties,  Tasks,  and  Elements 
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1.2.1  Job 

The  duties  and  tasks  performed  by  a single  worker  constitute  his 
job.  If  i^ntlcal  duties  and  tasks  are  performed  by  several  Indivi- 
duals,-they  all  hold  the  same  job. 

The  job  Is  the  basic  unit  used  1n  carrying  out  the  personnel  actions 
of  selection,  training,  classification,  and  assignment.  In  the  Army  and 
hterine  Corps,  such  groupings  or  jobs  are  oeflned  as  Military  Occupational 
Specialties  (MOS).  In  the  Air  Forca,  they  are  defined  as  Air  Force 
Specialties  (AFS) , while  the  Navy  defines  them  as  ratings.  Thrrse  Defense 
Occupational  Specialties  (DOS)  form  the  occupational  basis  of  the  services' 
personnel  management  system.  That  is,  they  Identify  work  requirements 
and  individual  qualifications,  facilitate  assigninent  and  distribution 
of  personnel,  provide  for  trained  replacements,  and  facilitate  more 
accurate  estimates  of  force  recui rements . 

Some  examples  cf  jobs  are; 

EXAMPLES 

1.  Wheeled  vehicle  mechanic 

2.  Administrative  officer 

3.  Pilot  of  jet  aircraft 

4.  Electronic  equipment  repairman 

5.  Military  policeman 

6.  F:re  chief 

The  relationship  between  several  of  these  job  examples  and  their  related 
work  activities  is  shown  in  Figures  1.2  and  1.3. 
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FIGURE  1.3:  The  Job  of  a 7D  Pilot 
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1.2.2  Duty 

A duty  Is  one  of  the  major  subdivisions  of  work  performed  by  one 
Individual.  A job  1s  made  up  of  one  or  more  duties. 

The  following  are  some  of  the  characteristics  of  duties: 

1.  A duty  Is  one  of  the  job  Incumbent's  main  functions. 

It  sometimes  may  be  a particular  Job  Incumbent's  total  job, 

2.  A duty  is  a grouping  of  closely  related  tasks. 

3.  Duty  requirements  often  are  the  basis  for  Initial  assignment 
to  a job,  for  determining  the  qualifications  required  to  per- 
form in  the  job,  or  for  determining  requirements  for  post- 
assignment training. 

Dutle?  can  usually  be  defined  by  asking  a supervisor  what  he  thinks 
are  the  5 or  6 most  critical  factors  of  a job  or  what  he  would  demand 
of  a person  being  considered  for  a job.  In  the  case  of  a clerk/typist, 
for  example,  he  may  say,  "(1)  Ability  to  operate  equipment,  (2)  ability 
to  route  correspondence,  (3)  ability  to  maintain  files,  and  (4)  ability 
to  prepare  correspondence."  The  job  of  clerk/typist,  even  after  exhaustive 
analysis,  probably  will  be  found  to  consist  of  four  duties,  i.e.,  OPERATING 
equipment,  MAINTAINING  files,  ROUTING  correspondence,  and  PREPARING  corres- 
pondence. 

Selection  of  duty  titles  often  is  somewhat  arbitrary  and  subjective} 
however,  they  should,  whenever  possible,  reflect  field  usage  and 
terminology.  Duty  titles  often  are  used  In  job  analysis  for  categorizing 
groups  of  tasks  under  identifiable  headings  to  help  in  the  organizing  of 
lists  of  tasks.  At  other  times,  duty  titles  are  assigned  for  convenience 
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after  tasks  have  b«n  Identified  and  grouped.  In  either  case,  the  duty  | 

. ■ i 

title  serves  to  clearly  Identify  closely  related  groups  of  tasks.  . | 

A «^d  way  tc  write  duty  statements  Is  to  use  action  M)rds  ending  I 

•In  "-Ing"  to  describe  duties.  This  wording  fits  the  intent  of  the  duty  | 

■ • ' I 
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i stateiiient  In  the  job  Inventory  since  the  "-Ing"  relates  the  word  to  an  j 

entire  function  rather  than  to  an  Individual. action.  The  action  word  J 

generally  is  followed  by  an  object.  J 

Some  examples  of  duties  ar«:  | 

. ' i 

I 

/ 

EXAMPLES  ‘ 


1.  For  wheeled  vehicle  mechanics:  tuning  engines^ 
adjusting  and  repairing  brakes,  repairing  exhaust 
systems,  repairing  suspension  systems,  and  repairing 
electrical  systems. 

2.  For  an  administrative  officer:  evaluating  requests 
for  action,  planning  future  work  activities,  staff- 
ing, organizing  staff,  training  staff.  Implementing 
plans,  and  evaluating  performance. 

3.  For  an  A- 70  pilot:  preparing  for  A-7D  mission,  per- 
forming basic  flight  maneuvers,  performing  advanced 
flight  maneuvers,  and  performing  Instrument  flight 
maneuvers . 


1 

I 
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1.2.3  Task 

Job  analysis  actually  Is  accomplished  at  the  task  level.  As  you 
win  recall,  duties  are  actually  clusters  of  tasks,  the  performance  of 
which  constitute  the  duties.  Job  analysis  goes  much  deeper  Into  job 
activity  description  at  the  task  level  than  It  does  with  the  more  general 
duty  statements,  A task  Is  the  lowest  level  of  behavior  in  a job  that 
describes  the  performance  of  a meaningful  function  In  the  job  under  con- 
sideration. Examination  of  the  job  at  the  task  level  allows  the  job 


^ . . . I'  . 
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to  be  described  in  sufficient  detail  to  serve  as  the  basis  for  a complete 
instructional  system. 

Task  statements  imjst  be  constructed  carefully  to  assure  that  the 
final  analysis  yields  usable  job  performance  data.  The  following  are 
characteristics  of  tasks  and  task  statements: 

1.  A task  statement  is  a statement  of  a highly  specific  action. 

Tne  statement  has  a verb  and  object. 


EXAMPLE 

1.  "Repair  wheeled  vehicles"  is  not  sufficiently 
specific  to  be  a good  task  statement.  To  one 
Individual,  such  a statement  might  mean  per- 
forming such  actions  as  "replace  wiper  blades" 
and  "replace  burned-out  head  lamp".  Another 
person  might  think  it  means  "overhaul  trans- 
mission and  engine". 

2.  Also  "inspect  and  repair  exhaust  system"  is 
not  sufficiently  specific.  However,  one  task 
might  be  "inspect  exhaust  system,"  an3T?nother 
task  be  "repair  exhaust  system." 


2,  A task  has  a definite  beginning  and  end. 


EXAMPLE 

Such  action  phrases  as  "have  knowledge  of"  or  "take 
responsibility  for"  are  not  time- ratable  and  there,- 
fore  should  not  be  included  in  a task  statement. 


3.  Tasks  are  performed  in  relatively  short  periods  of  time,  i.e., 
seconds,  minutes,  or  hours,  but  rarely,  if  ever,  days,  weeks, 
months,  or  years.  Although  no  definite  time  limit  can  be 
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set,  th€  longe  the  period  of  tine  between  the  beginning 
and  the  completion  of  the  activity,  the  greater  the 
probability  that  the  activity  Is  a generality  or  goal  rather 
than  a task. 

EXAHPLE 

“To  assure  a well-trained  am^y"  Is  probably  a goal, 
not  a task. 

4,  Tasks  must  be  observable  in  that  by  observing  the  performance 
of  the  job  holder  or  the  results  of  his  efforts  a definite 
determination  can  be  made  that  the  task  has  been  performed. 


EXA^«>LE 


"Understand  electronic  principles"  Is  not 
observable.  Neither  the  process  nor  the 
results  can  be  observed.  (However,  certain 
actions  that  require  an  understanding  of 
electronic  principles  can  be  observed.) 


5.  A task  must  be  measurable;  that  is.  In  the  real  world,  a 

technically  proficient  Individual  can  observe  the  performance 
of  the  task  or  the  product  produced  by  the  task  and  be  able 
to  conclude  that  the  task  has  or  has  not  been  properly  per- 
formed. 

EXAMPLES 

1.  "Know  how  to"  or  "be  able  to"  are  not 
measurable.  Neither  are  they  observable. 

2.  "Assure  success  of  mission"  Is  too  general 
to  be  measurable. 
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6.  Each  task  is  independent  of  other  actions.  Each  task  stitement 
must  describe  a finite  and  independent  part  of  the  job.  Tasks 
are  not  components  of  a procedure.  In  the  eyes  of  a Job  holder, 
a task  is  pi*rfonned  for  it:  own  sake  in  the  job  situation.  A 
task  is  either  performed  or  not  performed  by  any  one  job  holder. 
The  job  holder  is  never  responsible  for  only  part  of  a task. 

If  he  is  responsible  for  only  a part  of  a work  activity  that 
would  otherwise  be  defined  as  a task,  the  part  for  which  he  is 
responsible  i£  the  task. 


EXAMPLE 


If  one  of  the  wheeled  vehicle  mechanic's  tasks 
is  "repair  exhaust  system,"  "remove  muffler" 
might  be  one  element  of  the  task.  (We  will  diS' 
cuss  elements  in  more  detail  later.)  However,  a 
helper  or  trainee  might  be  assigned  the  task  of 
"remove  muffler."  For  the  mechanic  "remove 
muffler"  is  only  part  of  his  task.  His  responsi- 
bility is  not  fulfilTed  until  he  performs  the  other 
appropriate  work  elements  that  together  constitute 
"repair  exliaust  system,"  However,  the  trainee’s 
responsibility  for  this  particular  work  activity 
ends  as  soon  as  he  properly  "removes  muffler." 

The  wheeled  vehicle  mechanic  does  not  remove  the 
wheel  and  tire  from  a vehicle  for  the  purpose  of 
removing  the  wheel  and  tire.  The  removal  is  part 
of  a procedure  intended  to  accomplish  one  of  several 
tasks  such  as  rotate  the  tires,  repair  a flat,  or 
Tnstall  a new  tire.  The  latter  are  tasks  because 
they  are  independent  of  other  actions  and  are  done 
for  their  own  sake. 


Some  requirements  for  writing  good  task  statements  are  listed  in 
Table  I.l,  and  some  examples  of  satisfactory  task  statements  are  listed 
in  Table  1.2. 


TABLE  t1 

Task  Statement  Requirements 


REQUIREMENT 

TASK  STATEMENT 

1 

EXAMPLE 

Clarity 

Uss  wording  th&t  ts  easily  understood. 

"Compare  written  description  to 
.K  tuai  performance. " 

But  Not 

"Relate  rewits  to  teeds  oi  Held." 

Be  pncise  so  >r  means  the  sanie  thing  to  ah 

^ Use  words  such  as  "cheek,  coord i- 

personnet. 

nate,  assist"  with  caution-diey  are 
vague. 

i^rite  separate,  specific  statements  for  each. 

"Supervise  files." 

Avoid  combining  vague  items  e*f  skill,  know/- 

"Maintain  files. " 

edge,  or  responsibility. 

But  Not 

"Have  responsibility  for  maintain- 
ing ftles." 

Co"iplett*ness 

Use  abbreviations  only  after  spelling  out  the 

"Inventory  War- Readiness  Material 

term.  1 

1 

(WRM)"  may  be  followed  by  "Pre- 
pare requisitions  for  WRM. " 

Include  bo  tit  form  and  title  number  i/vnen 

"Complete  Task  Description  ^Vorl(■ 

1 

the  task  is  to  complete  a form,  unless  aft  that 
is  needed  is  the  general  type  of  form. 

sheet  (Form  No.  XXX)." 

Conciseness 

Be  brief. 

"Write  production  and  control  re- 

ports." 

But  Not 

"Accomplish  necessary  reports  in- 
volved in  the  process  of  maintaining 
production  and  control  pro- 
cedures " 

Begin  with  a present- tense  action  word 
(subject  or  "you"  is  understood!. 

"Clean"  or  "Write. " 

indicate  an  object  of  the  action  to  oe 
performed. 

"Clean  engine. " "Write  report. " 

Use  terminology  that  is  currently  used  on 

Use  most  recent  military  docu- 

the  job. 

mentation. 

Relevance 

1 

Do  not  stale  a person 's  qualifications. 

"Load  computer  tape. " 

But  Not 

“Has  one  year  computer  training. " 

Do  not  include  items  on  receiving  instruC' 
tion  unless  actual  work  is  performed. 

16 

"Prepare  tab  report. " 

But  Not 

"Attend  lecture." 

17 


TABLE  1.2 

Samples  of  Good  Task  Statements 


FUNCTKW  SATISFACTORV  TASK  STATEMENT 

Sorting  Items  of  mall  Into  Sort  mail, 

pigeon  holes. 

Taking  a patient's  history.  Determine  patient's  medical  history 

by  interviewing  patient. 

Fixing  carburetors.  Adjust  carburetor  Depending  on 

Replace  carburetor  what  is  meant 
Rebuild  carburetor  by  "fix." 

Deciding  where  to  begin  Select  troubleshooting  strategy 

troubleshooting  of  (specific  for  (specific  item  of  equipment), 

electronic  item). 

Establishing  the  objectives  Specify  course  objectives, 

for  a course. 

1,2,4  Element 

An  element  is  the  smallest  "package"  of  behavior  that  has  practical 

I meaning  to  the  instructional  designers.  By  "has  practical  meaning,"  we 

\ 

\ mean  that  further  subdivision  of  the  element  would  be  unnecessary  since 

1 the  instructional  designers  fully  understand  the  element  without  further 

subdivision.  To  be  useful  as  a basis  for  developing  instruction,  step- 
! by-step  direction  and  guidance  is  required  as  to  how  the  task  is  performed, 

t The  work  activities  that  make  up  this  step-by-step  direction  and  guidance 

I are  the  elements  that  make  up  the  task. 

I The  elements  that  make  up  each  task  imjst  be  determined  for  two  reasons. 


First,  since  many  of  the  tasks  will  be  selected  for  training,  the 
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instructional  designer  must  have  sufficient  details  of  the  tasks  to  provide 
a solid  basis  for  training.  If  individuals  are  going  to  be  trained  to  do 
a task  or  be  provided  with  job  aids  to  help  them  perform  a task,  those  who 
develop  the  training  or  Job  Performance  Aids  nust  know  exactly  how  the  task 
is  done.  (Note:  Job  Performance  Aids  (JFAs)  are  manuals,  checklists,  or  any 
other  devices--ofteri  attached  to  equipment--that  assist  Individuals  in  per- 
forming certain  operations.) 


EXAMPLE 


If  the  task  of  "perform  before-operation  maintenance 
on  2 1/2 -ton  truck"  will  need  to  be  performed,  either 
individuals  must  be  trained  to  do  the  task  or  Job 
Performance  Aids  must  be  provided  that  will  show  the 
individuals  exactly  how  to  perform  the  task.  In  either 
case,  t-he  instructional  developers  must  know  the  elements 
that  make  up  the  task.  These  elements  are: 

a.  Check  oil  and  coolant  levels. 

b.  Inspect  pulleys  and  fan  for  alignment,  and  belts  for 
tension.  Check  water  pump  and  hose  clamps  for  leaks. 

c.  Inspect  air  compressor  and  connections  for  security 
of  mounting.  Check  belts  for  tension, 

d.  Visually  inspect  exposed  electrical  wiring,  conduits, 
connectors,  and  shielding  for  cracks  or  breaks. 

e.  Inspect  engine  compartment  for  indications  of  fuel, 
engine  oil,  or  water  leakage  or  seepage. 

f.  Drain  each  fuel  filter  daily  before  starting. 

g.  Check  level  of  water  in  batteries.  Check  terminals, 
clamps,  and  holddown  frames  for  security  and 
corrosion. 

h.  Check  for  loose  wheels  and  correct  tire  pressure. 

1.  Check  general  condition  of  body  tor  scratches,  dents, 
and  holes. 


O’ 
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j.  Inspect  cab  and  cab  bcdy  mountings  and  springs. 

k.  Inspect  transfer  pomer  takeoff » front  winch  drum  lines, 
drive  shaft  U-Joints,  and  shear  pins. 

l.  Check  service  break  for  proper  travel. 

m.  Notice  if  starter  pedal  requires  only  nomal  pressure 
to  engage  starter  and  that  engine  starts  iim^diately 
without  unusual  noises. 

n.  Check  Instruments  . .oon  as  you  start  the  engine.  If 
oil  pressure  stays  at  zero  or  is  very  low,  SHUT  DOWJ. 
Normal  idle  pressure  Is  15  ps1. 

0.  Operate  horn,  lights,  and  windshield  wipers, 

p.  Listen  for  any  unusual  noises  with  engine  under  load. 

Without  at  least  this  level  of  detail  of  how  the  task  Is 
done,  the  instructional  designer  could  not  prepare  mean- 
ingful instruction  or  meaningful  Job  Performance  Aids, 


The  second  reason  for  determining  the  elentents  that  make  up  a task 
is  that  some  task  statements  look  alike  even  though  the  tasks  are  quite 
different.  Some  task  statements  may  have  the  same  verb  and  object  and 
only  appear  different  when  the  elerents  are  added.  As  an  example,  note 
that  in  Table  1.3,  while  the  task  statement  is  the  same,  the  actual 
task  is  quite  different  for  the  different  job  levels.  The  elements  that 
make  up  the  task  give  a special  "flavor"  to  the  task  at  each  job  level. 
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TABLE  1.3 

Relationship  Between  Task,  Job  Level,  and  Eleirents 


TASK 

JOB  LEVEL 

ELEMENTS 

Prepare  Reports 

Very  low 

Fill  out  logs 

Count  units  of  material 

Compute  indices 

Prepare  Reports 

Intermediate 

Cont)ine  totals 
Integrate  information 
Prepare  drafts 

Prepare  Reports 

Upper 

Check  accuracy 
Finalize  format 
Obtain  concurrence 

Prepare  Reports 

Highest 

Approve  reports 
Release  reports 
Interpret  reports 

The  ♦■asks  in  the  example  differ  in  the  dimensions  of  complexity  and 
amount  of  implied  activity.  Since  one  use  of  the  list  of  tasks  that 
make  up  a job  will  be  to  collect  data  for  use  in  deciding  which  tasks  to 
t'.*ain,  tasks  must  be  documented  in  sufficient  detail  so  that  those  who  will 
later  provide  you  with  this  data  will  know  what  task  you  are  talking  about. 
Often  this  will  require  you  to  list  at  least  some  of  the  elements  that 
make  up  certain  tasks. 

In  Section  1.2.3,  a list  of  characteristics  of  tasks  cas  given. 

All  but  one  of  these  characteristics  of  tasks  are  also  characteristics  of 
elements.  The  last  characteristic  listed  for  tasks  (item  number  6)  points 
out  the  major  differences  between  a task  and  an  element.  These  differences 
a 
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1.  Each  task  is  independent  of  other  tasks.  Each  elenant  Is 
dependent  upon  other  elcinents.  An  element  Is  relatively 
meaningless  outside  of  the  group  of  elements  that  make  up  a 
task. 

2.  Tasks  are  not  components  of  a procedure.  Elements  are  always 
components  of  a procedure, 

.1.  In  the  eyes  of  £ job  incuni)ent,  a task  is^  performed  for  its 
own  sake  in  the  job  situation.  An  element  is  never  performed 
for  its  own  sake  in  the  job  situation.  An  element  is  one  step 
in  the  performance  of  a task.  The  elements  of  a task  constitute 
a description  of  how  the  task  is  accomplished, 

This  step-by-step  description  of  the  task  must  be  detailed  enough 
to  be  followed  by  these  who  need  to  understand  how  the  task  is  performed. 
This  means  a great  deal  of  judgment  tmjst  be  used  to  list  elements.  There 
is  a Icwer  limit  to  the  degree  that  elements  can  be  subdivided.  This 
limit  is  the  point  at  which  further  subdivision  would  result  in  breaking 
the  elements  into  such  basic  work  units  as  the  separate  motions,  move- 
ments, and  mental  processes  involved.  There  is  also  an  upper  limit  to 
the  degree  ♦■hat  elements  must  be  subdivided.  This  limit  is  the  point  at 
which  less  subdivision  would  certainly  fail  to  present  a clear  description 
of  how  the  task  is  performed.  The  practical  limit  is  usually  somewhere 
between  these  two  extremes.  You  should  subdivide  the  element  to  the 
point  necessary  for  communicating  with  those  who  will  use  the  infomia-> 
tion,  and  no  further. 
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EXAMPI  E 

One  element  In  the  task  of  repairing  electronic  equipment 
might  be  "solder  connection."  If  those  who  need  to  under- 
stand how  the  task  is  performed  have  a clear  understanding 
of  "solder  connection,"  it  is  probably  safe  to  say  the 
element  need  not  be  subdivided  into  smaller  "packages"  of 
behavior.  However,  if  this  element  statement  is  not  clear 
to  those  who  need  to  understand  the  task,  further  sub- 
division is  required.  The  new  elements  might  be: 

1.  Strip  1/2"  of  insulation  from  end  of  wire. 

2.  Wrap  stripped  portion  of  wire  securely  around  terminal. 

3.  Place  soldering  iron  and  solder  at  junction  of  wire  and 
terminal  until  solder  flows  over  joint  area. 

4.  Remove  solder  and  soldering  iron. 

If  these  elements  are  clear  to  those  who  need  to  undorsi.and 
the  task,  this  is  a good  stopping  point.  If  not,  some  of  the 
elements  may  have  to  be  further  subdivided. 


Just  as  important  as  knowing  what  the  elements  are,  is  understanding 
the  relationships  between  elements.  The  elements  within  a task  will  be 
either; 

1.  fixed  sequence  (the  elements  always  are  done  in  the  same  order), 

2.  alternate  path  (the  specific  situation  encountered  determines 
the  appropriate  sequence),  or 

3.  a combination  of  both. 


Diagramming  the  relationships  often  is  required  to  understand  and 
remember  the  relationships.  Figure  1.4  is  an  example  of  a diagram  for 
the  task  of  repairing  electronic  equipment.  Note  that  the  figure  shows 
both  fixed-sequence  elements  (such  as  5 through  10)  and  alternate-path 


1.  VERIFY  TROUBLE 


2.  DETERMINE  IF  REPAIRS 
CAN  BE  MADE  ON  SITE 


3,  RETRIEVE  EQUIPMENT 


CAN 

BE  FIXED  ON 
SITE 
? 


4.  ASSEMBLE  TOOLS/PARTS, 
GO  TO  EQUIPMENT 


11.  COMPLETE  REPAIR  REPORT 


5.  SECTIONALIZE  EQUIPMENT 


6.  LOCALIZE  MALFUNCTION 


7.  ISOLATE  MALFUNCTION 


8.  IDENTIFY  MALFUNCTION 


9.  REPAIR  MALFUNCTION 


10.  TEST  OPERATE 
EQUIPMENT 


FIGURE  1A-.  Diagram  ol  Elemenls  for  the  Task  of  Repair  Electronic  Equipment 
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elements.  The  first  branch  shows  that  the  appropriate  alternate  sequence 
depends  upon  where  the  task  is  performed  (element  3 Is  one  possible  path, 
and  elenrent  4 another  possible  path).  The  second  branch  shows  that  the 
sequence  depends  upon  whether  or  not  the  initial  repair  corrected  the  mal- 
function (element  11  is  one  possible  path,  while  repeating  the  fixed 
sequence  5 through  10  is  another  possible  path). 

Some  guidelines  for  preparing  a diagram  of  a task  are; 

1.  Tentatively  sketch  elements  that  make  up  the  task,  from  start 
to  finish,  in  the  order  that  they  are  performed  on  the  job. 
Include  all  alternative  paths. 

2.  Mentally  rehearse  the  total  task.  Compare  the  diagram  with 
your  original  list  of  elements.  Make  sure  that  no  elements 
overlap  and  that  together  the  elements  account  for  all 
performance  required  in  the  task. 

3.  Revise  your  list  of  elements,  your  diagram,  or  both  until  you 
have  a perfect  match, 

4.  Number  each  element  on  the  diagram.  Follow  the  normal  job 
order  insofar  as  possible.  The  numerical  order  you  assign 
will  structure  the  order  of  your  list  of  elements  and  will 
make  your  list,  mors  understandable  to  others. 

5.  Document  carefully  since  this  task  may  ultimately  be  handled 
in  this  fashion  with  a Job  Performance  Aid. 

1.2,5  Conditions 

Conditions,  as  used  in  this  block,  refer  to  on-the-job  conditions 
that  significantly  influence  performance  of  a task.  These  significant 
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on-the-job  conditions  provide  the  basis  for  determining  Job  Performance 
Measure  conditions  and  the  necessary  training  conditions. 


EXAMPLES 

1.  Suppose,  in  order  to  accomplish  a task,  a Job  holder  is 
required  to  multiply  3-d1git  numbers.  This  statement 
alone  suggests  the  possible  need  for  training  in  mathe- 
matics. However,  if  one  of  the  conditions  of  the  task 
is  that  the  individual  performing  the  task  is  provided 
with  an  electric  calculator,  the  implications  for 
training  are  considerably  different. 

2.  Another  task  might  require  attaching  cables  to  various 
items  so  that  the  items  can  be  lifted.  If  one  condition 
of  the  task  is  that  this  must  be  accomplished  20O  feVt 
under  water,  this  again  has  serious  implications  for 
training. 


The  major  items  that  need  to  be  included  in  an  accurate  and  complete 
statement  of  task  conditions  are  listed  in  Table  1,4. 

While  good  job  analysis  documentation  requires  a conditions  statement 
for  each  task,  it  is  often  the  case  that  a group  of  tasks  will  have  identi- 
cal or  nearly  identical  conditions.  This  means  that  careful  planning  can 
reduce  the  effort  required  in  documenting  the  conditions,  One  approach 
is  to  document  the  several  groups  of  conditions  that  appear  likely  to 
cover  most  tasks.  Then,  for  each  task,  the  appropriate  group  of  conditions 
can  be  referenced  and  any  additions  or  deletions  listed.  Appendix  A, 
page  89.  is  an  example  of  how  this  was  done  for  the  task  of  "troubleshoot 
a telephone  set." 

1.2.6  Cues 

A cue,  as  used  in  this  block,  is  the  state  of  affairs  or  the  occur- 
rences that  determine,  in  the  job  situation,  when  the  Job  incumbent 
performs  a particular  task  according  to  a particular  procedure. 


TABLE  1.4 


Guidelines  for  Documenting  Task  Conditions 


ITEM  TO  BE  included 
IN  STATEMENT  OF  TASK 
CONDITiC»IS 

EXAMPLES 

1.  Tools  and  equipment  used 
to  perform  the  task. 

1.  Cleanroom  overalls 

2.  Lead-lined  gloves 

3.  A-7D  aircraft 

4.  Soldering  Iron 

2.  Special  Job  aids  and 
manuals . 

1.  Procedural  checklists 

2.  Technical  manuals 

3.  Kind  and  amount  of  super- 
vision and  assistance 
normally  available 
during  task  performance. 

1.  Job  holder  performs  task 
completely  Independent  of 
assistance  from  others. 

2.  Task  performed  under  close 
supervision. 

3.  Task  performed  as  'a  menter 
of  a team. 

4,  Special  physical  demands 
of  the  task. 

1.  Crowded  working  conditions. 

2.  Unusual  or  prolonged  physical 
exertion. 

3.  Kneeling  or  squatting. 

4.  Unusually  cramped  position. 

5.  Environmental  conditions 
that  influence  task 
completion. 

1,  Tropical  environment. 

2,  Arctic  environment. 

3,  Desert  environment. 

6.  Location  of  performance. 

1.  Air  conditioned  building. 

2.  Outdoors  in  all  weather 
conditions. 

3.  At  night  in  total  darkness. 

4.  Direct  support  maintenance 
van. 
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EXAMPLE 

1.  For  a wheeled  vehicle  mechanic,  a flat  tire  on  a vehicle 
that  he  was  supposed  to  repair  would  be  a that  should 
result  in  his  changing  the  tire  or  repairing  the  tire. 
Other  cues,  such  as  length  of  time  before  the  vehicle  r>^t 
be  driven,  location  of  the  vehicle,  and  availability  oi 
spare  tire,  would  determine  which  of  several  actions  he 
should  take;  that  Is,  whether  he  should  change  the  tire 
and  possibly  repair  It  later,  or  whether  he  should 
inmedlately  repair  the  tire. 

2.  Certain  cues  not  only  "cause"  a medical  corpsman  to  begin 
the  task' oT" administering  first  aid  to  an  injured  person 
but  also  determine  how  he  performs  the  task.  If  the 
victim's  breathing  had  stopped,  the  trained  corpsman  would 
not  beg.n  first  aid  by  splinting  the  victim's  leg. 

3.  Sometimes,  the  cue  is  "Smith,  fix  that  engine,"  or  "Smith, 
replace  the  spark  plugs,"  etc. 


What  we  really  mean  by  "doing  a Job  right"  is  responding  appropriately 
to  the  various  cues  found  In  the  job  situation. 


EXAMPLE 

If  the  engine  of  a 1/4-ton  truck  does  not  "crank,"  this  Is 
a cue  for  the  wheeled  vehicle  mechanic  to  check  the  battery 
and  battery  cables.  However,  if  the  vehicle  engine  will  not 
start  and,  as  a result,  the  mechanic  changes  the  tire,  he  has 
not  done  his  job  satisfactorily  even  if  he  did  a perfect  Job 
of  changing  the  tire.  He  has  responded  inappropriately  to 
certain  cues. 


Adequate  job  performance  clearly  consists  of  more  than  performing  the 
work  elements  that  make  up  the  tasks  that  make  up  the  job.  The  correct 
order  and  appropriateness  of  performance  of  elements  and  tasks  depend 
upon  recognition  of  cues  and  upon  knowledge  of  the  correct  response  to 
each  cue.  An  adequate  job  analysis  has  not  been  conducted  unless  suf- 
ficient information  has  been  gathei-ed  to  give  the  instructional  designer 
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a clear  idea  of  the  cues  to  which  each  task  and  element  Is  the  appro* 
pH  ate  response. 

1,2.7  Standards 

Standard,  as  used  in  this  block,  refers  to  the  acceptable  quality  of 
performance  of  a task  in  the  rea1>wor1d  job  environment.  The  standard  for 
a task  is  a statement  of  how  well  the  task  must  be  performed,  1.f  and  when 
It  Is  performed. 


EXAMPLE 

A task  may  be  "destroy  enemy  fortification  with  nuclear 
warhead  equipped  missile."  Hopefully,  this  task  will 
never  need  to  bt  performed.  The  job  analyst  Is  not 
likely  to  see  the  task  performed,  and  from  the  satisfactory 
performance  write  the  standard  for  the  task.  The  standard 
for  this  task  1s  how  well  the  task  must  be  accomplished  If 
and  when  It  is  performed. 


Since  a task  standard  Is  a statement  of  how  well  a task  must  be  per- 
formed, regardless  of  the  cost,  time,  environment,  or  safety  hazards 
involved  in  performing  the  task,  the  task  standard  often  Is  not  used  to 
actually  measure  task  performance.  However,  task  standards  are  the  basis 
for  job  performance  measure  standards. 


EXA1VLES 

1.  One  task  of  a demolition  expert  might  be  to  blow  up 
bridges.  However,  since  bridges  are  expensive  and 
take  a long  time  to  build,  the  Job  analyst  probably 
would  not,  by  actual  observation,  measure  how  well 
the  demolition  expert  blew  up  bridges.  However,  a 
standard--how  well  this  task  roust  be  perforroed--must 
be  established  and  agreed  upon.  This,  then,  becomes 
the  basis  for  the  standard  of  performance  whatever 
test  is  devised  to  find  out  if  the  demolition  expert 
knows  how  to  perform  the  task  of  "blow  up  bridges." 
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2,  One  task  of  a pilot  might  be  to  abandon  a flaming  air- 
craft. However,  this  Is  a dangerous  and  costly  pro- 
cedure; and,  even  If  the  job  analyst  could  afford  to 
judge  tne  pilot's  performance  by  having  him  actually 
carry  out  t!;e  task,  the  Job  analyst  would  have  con- 
siderable diffic.;liy  In  finding  a way  to  observe  the 
performance.  Again,  a standard  imist  be  established  and 
agreed  upon.  This  task  standard  Is  the  basis  for  the 
standard  for  the  actual  measure  of  task  performance. 

(These  Job  Performance  Measures  (JPMs),  win  bo 
constructed  in  Block  1.3.) 

3.  One  task  of  a wheeled  vehicle  mechanic  might  be  "perform 
before-operation  maintenance  on  2 I/2-ton  truck."  For  this 
task,  since  there  are  no  real  constraints  to  having  the 
mechanic  actually  perform  the  task  while  his  performance  Is 
observed,  the  task  standard  might  become  the  actual  JPM 
standard. 


This  whole  idea  of  performance  testing  where  serioifs  testing  constraints 
exist  will  be  discussed  in  detail  in  Block  1.3:  CONSTRUCT  JOS  PERFORMANCE 
MEASURES.  However,  the  basis  for  the  standards  for  Job  Performance  Measures 
(JPMs)  that  you  will  develop  in  Block  1.3  must  be  sound  statements  of  the 
standard  of  performance  actually  required  on  the  job. 

The  standard  of  performance  of  a task  can  be  described  by  defining  an 
acceptable  product,  by  defining  an  acceptable  process,  or  by  defining  both. 
The  standard  should  be  defined  in  terms  of  an  acceptable  product  if: 

1.  The  product  is  observable  and  can  be  inspected. 

2.  The  process  by  which  the  product  was  produced  cannot  be 
easily  observed. 

3.  The  process  is  relatively  uninportant  as  compared  to  the 
product. 


Some  examples  of  tasks  where  the  standards  should  be  defined  in  terms 


of  a product  are: 


EXAMPLES 


1.  Prepare  a tactical  operations  plan, 

?.,  Develop  a computer  progrsn. 

3.  Dig  trench  E feet  deep  and  25  feet  long. 

The  standard  should  be  defined  In  terms  of  an  acceptable  process  if; 

1.  Performance  of  Uie  task  does  not  leave  a readily  observable 
product. 

2,  Failure  to  use  the  correct  process  could  result  In  damage  to 
equipment  or  danger  to  the  perfomwr  or  others. 

EXAMPLES 

Some  examples  of  tasks  where  the  standards  should  be 
defined  in  terms  of  process  are; 

1.  Go  to  the  moon  and  back. 

2.  Defuse  defective  bomb. 

3.  Land  aircraft  on  flight  deck. 

Often  both  product  and  process  are  in^ortant . 


EXAMPLE 


If  a task  requires  that  a motor  vehicle  be  driven  from 
point  A to  point  B,  the  existence  of  the  vehicle  at 
point  B could  provide  a product  standard.  However,  since 
the  driver  might  have  run  10  other  vehicles  off  the  high- 
way 1n  the  process,  the  product  standard  alone  would  not 
be  sufficient. 
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The  process  standard  for  the  task  in  the  above  example  probably  could 
be  considered  to  be  In^lied  In  the  task  statement.  This  will  be  discussed 
later. 

Standards  generally  describe  products  in  terms  of: 

1.  accuracy,  tolerances,  con^leteness , format,  clarity,  and 
nun*»er  of  errors , and 

Z.  quantity;  that  Is,  the  number  of  work  units  produced 
per  time  unit. 

Process  standards  generally  are  described  In  terms  of  sequence,  conplete- 
ness,  accuracy,  and  speed  of  performance. 

Often,  task  standards  have  already  been  established  and  are  documented 
in  military  publications.  Some  of  these  publications  are  listed  in 
Appendix  B,  page  95.  Such  documentation  can,  as  a minimum,  provide  a 
beginning  point  from  which  to  derive  standards  that  reflect  field  require- 
ments. This  will  be  discussed  in  greater  detail  later  in  this  block. 

Originally,  all  standards  had  to  be  derived  either  by  a panel  of  experts 
with  experience  in  performing  or  supervising  the  tasks,  or  from  actual  job 
performance  data  collected  by  direct  observation.  This  means  that  if 
standards  for  a particular  task  are  not  already  documented,  one  of  these 
approaches  will  be  required  to  derive  the  standards. 

The  standards  for  some  tasks  can  be  at  least  partially  derived  from  the 
characteristics  of  the  equipment  required  to  perform  the  tasks. 

EXAMPLE 

Long-duration  fire  bursts  by  a machine  gunner  may  overheat 
and  damage  the  weapon.  Therefore,  in  addition  to 
accuracy,  the  standard  must  include  a maximum  burst 
duration. 
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Standards  should  be  dociaented  In  sufficient  detail  to  accuratelj^ 
cOBBunicate  the  requirements  of  the  job  to  the  Instructional  designer 
who  will  use  this  information.  Often,  to  sln^llfy  writing  the  standards 
statements,  a number  of  Infilled  standards  are  not  Included  In  the  docu- 
mentation but  are  Intended  to  be  a part  of  the  standard.  Some  of  these 
Infilled  standards  are  "complete  and  accurate."  "submitted  on  time,"  and 
"correct  solution."  This  means  that  for  some  tasks,  the  standard  of 
performance  Is  Implied  In  the  task  statement  and  need  not  be  listed  as 
a separate  Item. 

EXAMPLE 

If  a task  is  to  drive  a 1/4-ton  truck  from  point  A to  point 
B,  "obeying  traffic  laws"  can  normally  be  assumed  to  be  part 
of  the  standard.  This  means  it  is  an  impl led  standard. 

However,  in  the  case  of  a military  pol 1 ceman , the  task  may 
require  that  he  violate  certain  traffic  laws.  If  tills  Is  the 
case,  the  standard  nust  be  stated. 

While  standards  foi  some  tasks  can  be  confidently  and  objectively 
stated,  standards  for  many  tasks  are  highly  subjective.  What  would  be 
the  standard  for  "repair  carburetor  on  a wheeled  vehicle"?  Suppose  pro- 
duct standards  for  repaired  and  rebuilt  carburetors  are  well  documented 
in  technical  manuals.  Does  this  product  standard  provide  an  acceptable 
standard  for  performance  of  the  task?  If  it  takes  the  mechanic  two 
months  to  make  the  repair,  is  that  acceptable?  If  not,  how  long  should 
it  take?  But  how  long  it  takes  depends,  at  least  in  part,  on  what  is 
wrong  with  the  carburetor.  To  determine  a separate  standard  for  making 
each  possible  contiination  of  repairs  to  the  carburetor  would  be  a huge 
effort;  fortunately,  this  is  not  necessary.  If  a time  standard  is 
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drived,  the  maxfmunt  length  of  time  required  by  most  mechanics  to  make 
most  repairs  should  be  adequate.  Any  exceptionally  lengthy  repairs 
could  be  given  a separate  stf^ndard  if  such  repairs  were  In  fact  found  to 
exist. 

1.3  Overview  of  Job  Analysis 

Job  analysis  begins • then,  with  the  recognition  of  a discrepancy  between 
Job  performance  ability  and  job  performance  needs— a discrepancy  that 
cannot  be  corrected  by  existing  training  courses,  either  because  no  such 
course  exists  or  because  analysis  of  existing  courses  (Block  1.4)  Indi- 
cated that  no  acceptable  course  exists. 

The  first  step  in  developing  adequate  training  is  to  collect  valid 
and  reliable  data  about  the  job.  The  original  source  of  valid  and  reliable 
job  data  Is  job  analysis.  The  steps  In  carrying  out  the  Job  analysis  are 
shown  in  Figure  1.5  (the  foldout  page  at  the  end  of  the  block). 

As  you  ulll  note  on  the  flowchart  In  Figure  1.5,  there  are  alternate 
routes  for  getting  from  the  beginning  to  the  end  of  this  block.  The 
procedures  that  follow  will  indicate  the  advantages  and  disadvantages  of 
the  different  routes.  The  ISO  process  does  not  dictate  a specific  pro- 
cedure. The  basic  requirement  is  that  you  make  logical  decisions  based 
on  the  resources  and  constraints  with  which  you  must  work.  The  guidelines 
that  follow  will  assist  you  in  making  those  logical  decisions. 

Regardless  of  the  route  that  you  take  through  this  block,  the  ultiir>ate 
end  product,  or  output,  must  include  a validated  list  of  tasks  that  make 
up  the  job.  These  tasks  must  be  described  in  sufficient  detail  to  permit 
collection,  in  Block  1.2,  of  valid  and  reliable  data  for  use  in  making 
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decisions  as  to  which  tasks  will  be  trained.  In  addition,  for  those 
tasks  selected  for  training,  sufficient  information  such  as  conditions, 
initiating  cues,  standards,  and  elenrents  must  be  collected  and  verified 
to  provide  a sound  basis  for  developing  Job  Performance  Measures  (JPMs) 
in  Block  1.3,  selecting  or  designing  instruction  in  Phase  III,  and 
conducting  external  evaluation  in  Block  V.2, 

Although  job  data  often  are  collected  at  the  lowest  level  of  organization 
(the  sailor,  artillerynian,  repair  man,  or  supervisor),  the  procedures  used 
must  be  coordinated  and  controlled  at  higher  levels  of  command.  If  this 
is  not  done,  the  personnel  system  or  training  program  may  reflect  "what 
exists"  rather  than  "what  should  be,"  If  a school  performs  job  analysis 
and  uses  the  data  to  construct  a training  program  without  careful  screening 
or  review,  there  is  a serious  risk  of  reflecting  too  many  "field  expedients" 
or  "stopgap"  measures.  Doctrine  must  be  carefully  and  appropriately  com- 
bined with  job  data. 

The  job  data  must  be  reviewed  by  responsible  staff  who  will  contribute 
to  them.  When  this  approach  is  used,  more  than  Just  approval  or  disapproval 
will  result.  Often  there  will  be  a change  in  applicable  doctrine  or  regula- 
tion controls.  This  procedure  helps  coordinate  such  related  actions  as 
»"ecrui tirent,  selection  and  assignment,  equipment  research,  development,  and 
procurement.  What  has  been  developed  is  basic  management  data.  Such  data 
can  be  of  considerable  value  if  it  is  furnished  to  each  cognizant  manager 
in  the  system. 


2.0  PROCEDURES 

The  procedures  section  of  this  block,  and  every  other  block,  will  follow 
the  flowchart  on  the  last  page  of  the  block.  It  may  help  you  keep  track 
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of  where  you  are  on  the  flowchart  If  you  leave  the  flowchart  folded  out 
while  you  use  the  procedures  section.  At  the  beginning  of  each  step  in 
the  procedures  Is  a reduced  copy  of  the  same  flowchart,  with  the  appropriate 
step  identified,  by  comparing  the  two,  you  should  be  able  to  keep  up  with 
exactly  where  you  are  In  the  block. 

2.1  Review  Available  Job  Information 

When  you  receive  a job  analysis  asslgrment, 
the  target  job  may  or  may  not  be  familiar  to 
you.  There  probably  is  one  advantage  to  not 
being  familiar  with  the  details  of  the  job. 

You  may  try  harder.  The  result  might  be  that 
you  will  pay  more  attention  to  the  actual 
details  of  the  job  and  will  tend  to  dig  deeper 
into  the  relationships  of  each  part.  This  will 
result  in  a clearer  picture  of  how  each  part  of 
each  other  part  and  where  these  bits  of  job  activity  fit  into  the 
total  picture  of  the  job. 

However,  starting  off  being  unfamiliar  with  the  job  does  not  mean  you 
can  stay  that  way.  Regardless  of  your  degree  of  familiarity  with  the  job, 
your  first  step  is  to  find  out  as  much  as  you  can  about  the  job  from  both 
official  and  unofficial  documents.  The  primary  purpose  of  this  review  of 
available  job  literature  is  to: 

1.  Learn  as  much  as  you  can  about  the  general  nature  of  the  Job. 

2.  Find  out  how  much,  if  any,  of  the  Job  analysis  work  has  already 
been  done. 


the  Job  relates  to 


illililllltilli 1 I.  I_ _l I..  ...L>  .1 .! I 


1.  Individual  and  observation  interviews. 

The  on-site  interview  and  observation  method  involves  sending  expert  job 
analysts  to  interview  job  incumbents  (job  holders)  and  their  supervisors, 
and  to  observe  job  incumbents  perfonning  the  work  activities.  In 
the  individual  interview,  data  can  be  collected  on  duties  and  tasks 
performed,  frequency  and  duration  of  performance,  conditions  under 
which  tasks  are  perfonned,  tools  and  equipment  needed,  cues  that  initiate 
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task  performance*  to  what  standards  the  task  must  be  accompHshed, 
and  the  elements  that  make  up  the  tasks. 

The  observation  interview  is  essentially  the  same  as  the  Individual 
interview  except  that  the  job  holder  is  observed  in  the  job  environment 
performing  all  or  a substantial  part  of  the  job.  As  the  job  holder  performs 
the  tasks,  the  analyst  may  ask  questions  to  obtain  a better  understanding 
of  the  job. 

The  individual  and  observation  interview  approach  is  probably  the  most 
practical  data  collection  method  for  getting  detailed  Information  about 
a job.  It  permits  flexibility  in  getting  the  required  data  and  provides 
an  opportunity  to  evaluate  the  quality  of  the  responses. 

Disadvantages  of  the  individual  and  observation  interview  method 
are  that  it  is  a time-consuming  process,  it  is  expensive  to  apply,  and 
its  effectiveness  is  largely  dependent  upon  the  skills  of  the  job  analyst. 
Also,  it  may  provide  some  nonessential  or  erroneous  information.  This 
can  be  corrected  by  interviewing  several  individuals  in  different  locations. 
Even  though  these  disadvantages  tend  to  limit  the  number  of  people  inter- 
viewed, there  is  doubt  as  to  the  validity  any  job  analysis  data  collected 
by  a method  or  combination  or  methods  that  does  not  include  some  individual 
and  observation  interviews.  Even  though  the  number  of  people  interviewed 
is  small,  the  importance  of  such  field  work  is  great. 

2.  Questi onnai re  survey . The  use  of  questionnaires  permits  the 
job  analyst  to  make  limited  contact  with  a large  number  of  individuals. 
Questionnaires  have  the  advantages  of  yielding  large  amounts  of  information 
at  a relatively  low  cost  and  of  not  requiring  trained  interviewers,  This 
survey  method  requires  the  inclusion  of  very  clear  instructions  since  the 
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job  analyst  will  not  be  present  to  give  assistance  and  answer  questions. 

A major  disadvantage  of  questionnaires  mailed  to  Individuals  is  that  returns 
tend  to  be  1cm,  especially  if  the  questionnaire  Is  long  and  Involved  and 
must  be  filled  out  on  a person's  own  time. 

Questlonnalt'es  can  be  mailed  to  individuals  who  are  asked  to  coinplete 
and  return  the  questionnaires.  Or  they  can  be  administered  to  groups 
of  job  Incumbents  and  supervisors  by  local  personnel  who  have  the  responsi- 
bility and  authority  to  make  sure  all  questionnaires  are  completed  and 
returned.  The  effectiveness  of  a questionnaire  survey  depends  largely  on 
Whether'  you  have  available  a “system"  or  organization  responsible  for  con- 
ducting such  surveys,  With  such  a system,  you  can  be  assured  of  having 
your  questionnaires  completed  and  returned  you.  This  is  true  because 
such  a system  has  the  authority  to  "make  it  happen."  Without  such  a system, 
the  results  of  a questionnaire  survey  may  be  less  than  desirable. 

There  are  two  basic  types  of  questionnaires,  the  closed  form  and  the 
open  form.  The  closed  form  corrcalns  a list  of  possible  Items  to  be 
selected  or  blanks  to  be  filled  iri  with  words  or  numbers.  This  form  has 
several  advantages.  It  is  likely  to  take  a minimum  amount  of  time  to 
complete,  thus  increasing  the  chances  that  it  will  be  completed  and 
returned.  The  process  of  tabulating  and  summarizing  responses  is  simpler 
and  less  time  consuming  than  with  an  open  form  questionnaire.  Machine 
tabulation  and  computer  analysis  of  the  completed  forms  are  practical 
when  a large  number  of  questionnaires  are  used.  However,  the  closed 
form  is  much  more  difficult  to  prepare.  The  designer  must  be  sure  to 
include  all  possible  responses  that  he  expects  from  any  of  the  people  who 
will  complete  the  questionnaire.  Also,  the  designer  must  construct  items 
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on  the  form  so  that  they  clearly  comnunlcate  to  the  users  exactly  what 
the  designer  1s  trying  to  ask.  All  but  the  last  Item  In  the  questionnaire 
In  Appendix  C,  page  100,  and  Appendix  D,  page  103,  are  exmnples  of  closed' 
form  questionnaires. 

The  open  or  free-response  questionnaire  gives  the  user  a great  deal 
more  freedom  In  responding  to  questions  about  Jobs.  More  complete  answers 
to  questions  are  possible.  It  Is  less  demanding  on  the  designer  because 
the  danger  of  overlooking  certain  responses  or  the  necessity  of  minimizing 
the  number  of  responses  is  reduced.  However,  this  form  has  several 
serious  disadvantages.  It  Is  much  more  difficult  and  time  consuming  to 
fill  out,  and  tabulating  and  suumarlzlng  the  responses  Is  a complex  and 
time-consuming  effort. 

Questionnaires  can,  of  course,  combine  the  open  and  closed  forms. 
Examples  of  open-form  Items  are  the  last  Item  In  Appendix  C,  page  100, 
and  Appendix  D,  page  1G3. 

3.  Jury-of-Experts.  With  this  method,  a group  of  personnel, 
selected  for  their  experience  and  knowledge  of  the  job.  Is  brought 
together  to  record  and  organize  the  required  job  analysis  data.  This 
method  is  particularly  useful  in  collecting  job  data  on  new  Jobs  or  on 
managerial  and  supervisory  jobs  where  many  of  the  most  critical  behaviors 
are  not  directly  observable.  Also,  the  Jury-of-Experts  method  can 'be 
effectively  used  as  a supplement  to  individual  and  observation  interviews. 
Since  the  members  of  this  jury  are  experts  In  the  Job  being  analyzed, 
their  collective  effort  should  be  decisions  about  the  requirements  of 
the  job.  In  general,  their  greatest  effectiveness  1s  in  evaluating  and 
making  decisions  about  job  data  that  have  been  collected  from  other 
sources  by  other  means. 
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This  method  can  be  very  expensive  because  of  the  personnel  involved 
and  the  time  required.  Also,  if  all  of  your  experts  come  from  schools, 
there  may  be  a tendency  for  the  outcome  to  reflect  what  exists  in  training 
rather  than  what  actually  exists  on  the  Job.  Experts  should  be  sampled 
from  a number  of  different  areas;  they  should  not  all  come  from  schools, 

4.  Group  interviews.  With  this  method,  a group  of  job  incumbents 
are  brought  together  to  provide  information  about  their  jobs.  The  job 
analyst  interviews  the  Job  holders  as  a group,  asks  questions  about  job 
performance,  and  possibly  has  the  group  list  job  data  on  data  collection 
forms.  Unlike  the  jury  of  experts,  the  group  interview  generally  is  not 
a decision-making  body.  Its  primary  function  is  to  provide  Information 
about  their  jobs,  not  to  make  decisions  about  existing  data  or  organize 
the  new  data. 

The  group  interview  is  a relatively  inexpensive  approach  to  collecting 
job  data.  It  can  be  put  to  good  use  in  gathering  data  on  tasks  that  can- 
not be  easily  demonstrated  or  observed  in  the  real  world  (for  example, 
tasks  that  are  performed  only  in  conbat).  However,  because  the  groop 
interview  involves  recall,  rather  than  recognition,  it  tends  to  provide 
data  that  are  incomplete  or  inaccurate. 

Most  job  analysis  data  collection  plans  for  existing  jobs  include  some 
combination  of  the  four  data  collection  methods  we  have  just  discussed. 

In  order  to  help  you  develop  an  appropriate  plan  for  your  particular  job 
analysis  effort,  we  will  discuss  tha  techniques  and  reasons  for  each  of 
four  different  plans.  One  of  them  should  fit  your  situation.  These  four 
plans  are; 
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1.  Anclysis  of  new  Job 

2.  Initial  emphasis  on  on-site  interviews 

3.  Initial  entasis  on  questionnaire  survey 

4.  Other 

Figure  1.6  shows  the  more  probable  alternate  paths  that  you  might 
choose  for  carrying  out  the  activities  required  In  Blocks  I.l,  1.2,  and 
1.3,  Reasons  for  choosing  a particular  path  will  be  given  along  with 
the  following  discussion  of  une  techniques  and  reasons  for  choosing  a 
particular  one  of  the  four  plans  listed  above. 

2.2.1  Analysis  of  New  Job 

If  the  job  you  are  going  to  ana1y::e  is  a new  job  (that  is,  no  one  is 
doing  the  job  now),  the  only  data  collection  methods  discussed  earlier  In 
this  section  that  will  be  of  much  use  to  you  Is  the  JUry-of-£xperts  method. 

The  other  methods  all  are  directed  toward  finding  out  what  an  existing  Job 
is  like.  Job  analysis  for  a new  job  requires  drastically  different  approaches. 
These  are  discussed  in  detail  in  Section  2.16  of  this  block.  If  you  are 
analyzing  a new  job,  turn  to  Section  2.16  for  details  of  how  to  proceed. 

2.2.2  Initial  Emphasis  on  On-Site  Interviews 

For  an  existing  job,  there  are  only  two  reasons  for  not  beginning  your 
job  data  collection  with  on-site  interviews  of  Job  holders  and  supervisors: 

1,  There  already  exists  a current,  complete  list  of  tasks  that 
make  up  the  Job,  and  you  have  available  in  the  field  Individuals 
with  the  responsibility  and  authority  to  assure  completion  and 
return  of  questionnaires  designed  to  validate  the  existing  task 
list. 


iNi*urs 
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FIGURE  1,6:  Possible  Alternative  Paths  for  Blocks  1.1 . 1.2  and  1.3 


A3 

2.  Constraints  of  time  or  funding  demand  that  you  do  a less  than 
adequate  Job  analysis.  Experience  has  shown  the  clear  advantage 
for  doing  the  first  job  analysis  right.  If  it  is  done  right  and 
completely,  it  tends  to  minimise  the  changes  necessary  when  it 
comes  up  for  periodic  review  (every  four  years,  more  or  less, 
depending  on  cortmand  decisions).  Further,  the  job  analysis 
portion  of  the  Phase  I effort  is  probably  the  most  important 
part  of  the  total  effort.  Keep  in  mind  the  old  familiar  saying: 
We  never  have  time  to  do  it  right,  but  we  always  have  tiri«  to 
■1j  it  again.  It  must  have  been  written  by  a professional  job 
analyst  who  was  pressed  to  do  a quick  and  dirty  job  in  the 
name  of  expediency. 

in  item  1,  2,2.2,  "current"  nieans  that  the  job  is  not  likely  to  have 
changed  significantly  since  the  task  list  was  prepared.  "Complete"  means 
you  can  determine  with  reasonable  assurance,  by  reviewing  the  list  with 
several  technical  advisors,  that  no  tasks  are  left  off  the  list.  At  this 
point,  we  do  not  mean  that  conditions,  initiating  cues,  standards,  and 
elements  are  listed  for  each  task. 

Since  this  task  list  might  have  been  prepared  from  various  technical 
documents  ratlier  than  from  actual  interview  and  observation  data,  validation 
of  the  task  list  by  a large  number  of  job  holders  and  supervisors  becomes 
critical.  This  is  the  reason  for  the  need  for  assurance  that  all  or  most 
of  the  questionnaires  used  to  validate  the  list  will  be  filled  out  and 
returned. 
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If  neither  item  1 nor  Item  2 fits  your  particular  situation, 
your  data  collection  plan  should  be: 

1.  Select  and  train  on-site  interview  job  analysts,  unless 
sioti  personnel  are  already  available.  (Section  2.3), 

2.  Prepare  or  select  Interview/observation  data  collection 
forms.  (Section  2.4), 

3.  Select  interview  sample,  (Section  2.5). 

4.  Make  administrative  arrangements  for  interviews/observations. 
(Section  2.6). 

5.  Conduct  interviews/observations,  and  collect  data. 

(Section  2.7). 

6.  Consolidate  data,  (Section  2,8). 

7.  Prepare  survey  questionnaires.  (Section  2.10), 

8.  Select  survey  sample,  (Section  2.11). 

9.  Conduct  questionnaire  survey,  (Section  2.12). 

10.  Revise  job  data  as  required.  (Section  2,13). 

11.  Collect  any  required  job  data  that  has  not  already  been 
collected.  (Section  2.14), 

Each  of  these  steps  is  discussed  in  detail  In  Sections  2.3  - 2.14  of 
this  block. 

Three  additional  decisions  will  have  to  be  made  before  you  can  call 
your  data  collection  plan  complete.  First,  in  collecting  data  in  step  5 
above,  how  much  data  are  you  going  to  collect?  You  have  tovo  major  options: 
1,  Concentrate  on  listing  the  tasks  that  make  up  the  job. 

Collect  only  enough  Information  to  prepare  a complete. 


understandable  task  list.  After  you  select  tasks  for  training 
(in  Block  1.2),  return  and  collect  conditions,  cues,  standards, 
and  elsTOnts,  gathering  information  on  only  the  tasks  selected 
for  training. 

?.  Initially  gather  all  the  information  you  are  likely  to  need 
on  all  tasks. 

You  should  decide  betweett  the  two,  based  on  convenience  and  economics. 
If  you  are  stationed  in  Washingt^^n  u.C.,  and  the  job  interviews  must  take 
place  on  an  aircraft  carrier  in  the  middle  of  the  Pacific,  you  probably 
will  wish  to  collect  as  much  information  as  possible  on  the  first  trip. 
However,  if  much  of  the  interviewing  will  be  done  near  where  you  will  be 
anyway  and  if  the  individuals  who  will  be  interviewed  are  readily  available 
at  any  time,  you  probably  will  wait  until  after  you  select  tasks  for  train- 
ing before  going  back  for  more  detailed  information. 

A second  decision  you  must  make  is  whether  Job  Performance  Measures 
(JPMs)  will  be  developed  at  the  same  time  you  are  conducting  interviews/ 
observations.  Often  a different  person  or  group  develops  JPMs.  However, 
if  the  same  people  will  be  analyzing  the  job  and  developing  JPMs,  there  is 
nothing  wrong,  particularly  in  remote  locations,  with  getting  as  much 
information  and  assistance  as  possible  on  the  first  trip. 

A third  decision  has  to  do  with  step  9 on  page  4^.  In  conducting  your 
questionnaire  survey,  will  you  only  validate  (make  sure  of  the  accuracy 
of)  your  task  list?  Or  will  you  also  collect  the  Block  i.2  data  for 
use  in  making  decisions  as  to  which  tasks  to  train?  Where  both  groups 
of  data  will  be  gathered  from  the  same  group  of  people,  you  should  do 
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both  at  the  same  time;  that  Is,  with  the  same  questionnaire  survey. 

However,  some  of  the  data  you  will  need  in  Block  1.2  may  be  required 
from  a different  group  of  people.  For  collecting  such  data,  you  will 
need  a different  questionnaire  and  a different  survey.  Either  way,  it 
probubly  is  clear  to  you  that  you  are  going  to  have  to  become  familiar 
with  Block  1.2  before  you  can  make  that  decision. 

2.2.3  Initial  Emphas is  on  Questionnaire  Survey 

If  a reasonably  current  and  complete  task  list  already  exists,  and  you 
have  resources  for  conducting  a thorough  questionnairo  survey,  your  data 
collection  plan  should  be: 

1.  Verify  task  inventory.  (Section  2.9). 

2.  Prepare  survey  questionnaires.  (Section  2.10). 

3.  Select  survey  sample.  (Section  2.11). 

4.  Conduct  questionnaire  survey.  (Section  2.12). 

5.  Revise  job  data  as  required.  (Section  2.13). 

6.  Collect  any  required  job  data  that  has  not  already  been 
collected.  (Section  2.14). 

The  only  additional  decisions  you  have  to  make  with  this  plan  are  the 
last  two  decisions  discussed  in  2.2.2,  Again,  if  tl;e  same  individuals 
who  perform  the  job  a.nalysis  also  will  develop  JPMs,  particularly  in  remote 
locations,  part  of  development  of  JPMs  can  be  done  concurrent  with  step  6 
above.  Also,  where  the  validation  data  and  the  da';a  for  making  decisions 
as  to  which  tasks  to  train  will  be  collected  from  the  same  group,  both 
data  should  be  collected  at  the  same  time. 
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2.2,4  Emphasis  on  other  Data  Collection  Methods 

Unique  conditions  or  constraints  in  your  command  may  dictate  tiiat  you 
use  some  data  collection  plan  other  than  the  ones  discussed  above.  In 
general,  when  you  are  forced  to  deviate  from  the  plans  already  discussed, 
the  effectiveness  of  training  programs  based  on  the  job  analysis  will  be 
reduced.  The  data  collection  plans  already  discussed  are  recomnended 
because  they  have  proven  to  be  a sound  basis  for  training  programs. 

This  cannot  be  said  of  short-cut  plans  that  you  may  be  forced  to  use. 

There  occasionally  are  practical  reasons  for  adopting  a less-than- 
ideal  plan. 


EXAMPLES 

1.  If  some  emergency  situation  demanded  that  a 
training  program  be  put  into  effect  in  a very 
short  period  of  time,  a nuiriber  of  short-cuts 
might  have  to  be  taken.  The  resulting  training 
might  be  less  than  ideal,  but  it  might  have  to 
suffice--at  least  until  you  have  time  to  do  it 
right. 

2.  If  a relatively  minor  change  in  a weapons  system 
made  necessary  some  changes  in  a few  tasks  that 
made  up  a job,  it  probably  would  not  be  practical 
to  analyze  the  entire  job  to  make  these  relatively 
minor  changes  or  additions. 


The  primary  point  here  is  that,  if  you  short-cut  any  part  of  the  job  analysis 
procedure,  it  should  be  a thoroughly  documented,  planned  deviation.  You 
should  know  you  are  doing  it,  know  why  you  are  doing  it,  and  be  willing 
to  accept  the  less-than-optimum  outcome  that  may  result  from  it. 

Details  of  carrying  out  alternate  data  collection  plans  are  discussed 


in  Section  2.15  of  this  block. 
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2.3  Select  and  Train  Job  Analysts 

Job  analysis  should  be  performed  only 
by  carefully  selected  military  and  civilian 
personnel  who  are  competent  in  the  conduct  of 
job  analysis.  Some  team  mentoers  may  be  drawn 
from  an  iristructlonal  staff,  but  the  team 
should  include  representatives  from  all  of 
the  conmand  elements  involved  in  decision 
making.  Hopefully,  at  least  most  of  your 
team  will  be  skilled  at  job  analysis.  If  you  have  some  members  who 
have  little  or  no  training,  you  should  team  them  with  skilled  per- 
sonnel until  they  have  demonstrated  their  competency  in  a job  interview 
si  tuatlon. 

Regardless  of  the  amount  of  previous  training,  each  team  member  will 
need  to  review  the  infonnation  that  you  have  collected  about  the  specific 
job  to  be  analyzed.  Each  member  must  become  familiar  with  the  general 
nature  of  the  job.  The  job  analysis  training  program  allows  them  to 
examine  background  materials  and  resolve  differences  of  opinion  about 
what  constitutes  the  job.  This  training  prepares  the  team  members  to 
record  and  document  details  of  the  work  activities  as  they  are  performed 
in  the  field.  Since  different  people  v-ill  be  involved  in  studying 
the  same  types  of  work  activities,  it  is  irnortant  that  each  records 
what  he  sees,  in  the  same  fashion,  and  that  each  tries  to  look  at 
various  factors  in  the  same  way.  Each  of  the  job  analysts,  however, 
comes  from  a different  background.  Each  tends  to  interpret  things 
differently  in  terms  of  this  background.  The  exchanges  and  arguments 
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during  the  job  analysis  training  period,  particularly  coming  to 
agreement  on  terms  and  interpretations.  Is  an  e,">treme1y  important  part 
of  the  readiness  program  for  effective  job  analysis. 

2.4  Select  or  Prepare  Interview  Data  Collection  Forms 

Two  basic  types  of  forms  are  needed 
for  recording  the  interview  data.  The  first 
’’v  ' form  for  recording  background  infotma- 
tion  about  the  person  being  interviewed. 

This  form  includes  identification  information, 
location,  previous  experience  and  education, 
and  other  job-related  information  apart  from 
the  specific  duties  on  tasks  performed.  An 
example  of  such  a form  is  shown  in  Figure  1.7. 

The  other  basic  form  is  for  use  in  recording  the  actual  job 
data.  This  form  can  serve  an  additional  purpose  of  giving  some 
structure  or  guidance  to  the  analyst  to  assist  him  in  asking  the 
right  questions  and  making  sure  he  has  the  details  he  needs.  You 
will  want  your  data  jollection  Forms  to  aid  the  members  of  your  job 
analysis  team  in  collecting  information  in  a systematic  manner,  but 
at  the  seme  time  be  sufficiently  flexible  to  permit  your  team  to  handle 
unique  situations.  The  design  of  the  particular  form  you  should  use 
depends,  of  course,  on  the  degree  of  detail  you  have  planned  to  reach  in 
the  particular  interview.  If  only  the  tasks  are  to  be  listed,  a relatively 
simple  form  will  be  adequate.  If  you  wish  to  collect  detailed  information 
about  each  task,  a form  such  as  that  shown  in  Figure  1.8  should  be 
adequate.  Details  of  how  to  use  such  a form  will  be  given  in  section  2.7. 
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JOB  ANALYSIS  INFORMATION  SOURCE 

DATE 

A.  IdentiHcation  Infonnation; 

1.  Name Rank  Svc.No. 

2.  Present  Work  Assigiiment 

3.  Primary  Specialty  

4.  Secondary  Specialty 

5.  Present  Pay  Grade 

B.  Job  Location  Information: 

1.  Official  Designation  of  Unit 

2,  Mailing  Address  


3.  Telephone  Number  and  Exten'ion 

4.  Present  Geographical  Location 

C.  Experience  and  Other  Job  Related  Information: 

1.  Total  Months  in  Present  Work  Assignment^ 

2.  Total  Months  in  This  Career  Field 

3.  Total  Months  at  Present  Base 

4.  Total  Months  in  Active  Military  Service 

5.  Re-enlistment  Plans 

6.  Highest  Education  Level  Completed 

7.  Nunt)er  of  Subordinates  Supervised 

8.  Primary  Job  Interest 

9.  Training  Received  for  Present  Work 


FIGURE  1.7:  Sample  Background  Information  Foi 


JOB  DATA  WORKSHEET 


FIGURE  1.8:  Samptle  Job  Data  Worksheet 
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2.5  Select  Interview  Sample 

You  are  now  read:.'  to  select  organi  ’ 
zations  and  individuals  to  provide  you 
with  the  needed  Job  data.  The  conplexity 
of  the  job,  the  availability  and  quality  of 
published  sources  of  job  information,  and 
the  nunter  of  people  in  the  particular  job 
will,  of  course,  determine  how  much  and 
what  kinds  of  information  you  need  to 
collect.  This  will  strongly  influence  the  make-up  and  size  of  your 
sample.  If  the  complexity  and  amount  of  required  data  are  great,  the 
number  of  organizations  and  individuals  interviewed  will  increase. 

At  the  beginning,  it  is  neither  possible  to  know  which  job  holders  and 
supervisors  will  give  the  best  and  most  complete  information,  nor  to  know 
precisely  how  many  interviews  will  be  required.  While  most  people  will  be 
cooperative  and  try  to  help,  you  are  likely  to  get  different  pictures  of 
the  job  from  different  individuals.  This  is  the  reason  for  interviewing 
a number  of  people.  In  this  way,  you  eventually  will  get  a clear  picture 
of  the  job  as  it  is  actually  being  performed.  Some  individuals  will 
describe  the  job  the  way  it  is  rather  than  the  way  it  ought  to  be.  Some 
will  describe  it  as  it  ought  to  be  rather  than  the  way  it  is.  Others  will 
describe  it  the  way  they  wish  it  were.  Some  will  simply  know  more  about 
the  job  than  will  others  and  will  be  able  to  provide  more  good  information. 
For  these  reasons  the  number  needed  is  likely  to  be  determined  p.s  the  inter 
views  progress.  The  job  analyst  steps  interviewing  when  he  and  authorita- 
tive advisors  believe  the  information  collected  presents  a well -structured 
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and  essentially  complete  picture  of  the  Job.  At  this  point,  additional 
interviews  yield  very  little,  if  any,  new  information.  Instead,  the 
new  inputs  begin  to  look  more  and  more  like  the  infoiination  already 
collected. 

From  five  to  ten  Interviews  from  each  of  several  representative  units 
often  will  be  adequate  for  a preliminary  task  list  in  a relatively  simple 
job.  Perhaps  at  least  twice  this  number  will  be  required  if  all  necessary 
information  about  each  task  is  collected.  As  a general  rule,  and  to  the 
extent  practical,  the  .nore  interviews  the  better.  At  least  it  is  safe  to 
say  that  too  many  interviews  is  better  than  too  few. 

In  selecting  units  for  interviews,  you  should  select  units  that: 

1.  Have  at  least  a small  number  of  job  holders  and  supervisors 
who  do  the  particular  job  to  be  analyzed.  Preferably,  you 
should  choose  some  units  that  have  a relatively  small  number 
of  job  holders,  and  some  units  that  have  large  numbers, 

2.  Are  geographically  and  environmentally  representative 

3.  For  interservice  programs,  are  representative  of  each  service 


In  selecting  individuals  within  the  units,  you  should 
made  up  of  individuals  who: 

1.  Perform  and  supervise  the  job  being  analyzed 
should  include  both  workers  and  supervisors.) 

2.  Perform  with  average  satisfactory  proficiency 

3.  Are  representative  in  terms  of  length  of  time 

4.  Are  representative  in  terras  of  training 


select  a group 
(The  group 


on  the  job 
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In  addition  to  th‘3  preceding,  you  will  want  to  choose  at  least  a few 
job  holders  or  supervisors  who  are  acknowledged  experts  at  the  job.  Frctn 
these  individuals t you  may  get  some  details  of  certain  tasks  that  you 
cannot  get  from  any  other  source, 

2.6  Make  Administrative  Arrangements 

As  soon  as  you  have  selected  your  survey 
sample,  you  need  to  coordinate  administrative; 
arrange.nents  to  include  some  or  all  of  the 
following; 

1.  Command  approval 

2.  Funding 

3.  Preparation  of  orders 

4.  Obtaining  passports  and  visas 

5.  Innoculations 

6.  Travel  reservations 

7.  Notificaticn  of  units  or  organizations  to  be  visited  for 
purpose,  time,  and  duration. 


2.7  Conduct  Interviews  and  Collect  Data 


Upon  arrival  at  each  unit,  you  and  your  team  should  present  a standard 
briefing  to  headquarters  staff  personnel,  conitianders , supervisory  personnel, 
and  the  Job  incimbents  in  the  survey  sample  units.  These  briefings  are  very 
important  because  the  full  cooperation  of  all  involved  and  concerned  is  very 
critical  to  the  success  of  the  Job  analysis.  Depending  on  the  number  of 
people  involved,  one  briefing  may  not  be  enough.  Maybe  a different  briefing 
for  each  of  the  different  levels  must  be  prepared  and  presented . The  briefings 
must  be  wel 1 -prepared  and  professionally  and  sincerely  presented.  They  must 
communicate  to  the  lowest  level  that  we  all  want  to  do  a better  job  and  the 
only  way  adequate  information  can  be  gathered  is  to  go  directly  to  the  actual 
on-the-job  person  and  to  his  supervisors.  Following  is  a list  of  the  reasons 
why  the  briefings  are  given  to  the  various  groups  listed.  The  briefings 
prepared  for  each  group  should  fulfill  these  needs. 

1.  Headquarters  staffs.  The  job  data  developed  will  become  the  basic 
management  information  for  this  group.  They  must  know  l/efore 
the  fact  what  you  are  doing,  how  you  are  doing  it,  and  what 
product  you  will  deliver.  They  should  also  realize  'hat  you  ■' re 
merely  going  to  report  what  is  happening  in  the  field.  If  what 
is  happening  is  not  what  people  think  is  happening  then  they 
(the  headquarters)  will  have  to  examine  the  data  and  make 
decisions  about  what  will  be  changed,  modified,  or  returned 
to  that  which  was  originally  envisioned.  If  the  way  the  job 
is  actually  being  performed  in  the  field  is  not  the  way  head- 
quarters wants  it  to  be  performed,  they  must  make  decisions 
and  take  appropriate  action  to  correct  the  variance.  They 
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must  tell  you  what  changes.  If  any,  they  Intend  making  to 
insure  that  your  final  job  analysis  data  reflect  what  should 
be  as  well  as  what  is. 

2.  Conwanders . The  commander  of  the  unit  you  will  visit  must  be 
made  to  realize  that  you  are  not  an  audit  team  or  an  inspector 
general.  You  are  there  to  observe  the  way  his  jobs  are  done 
so  that  the  training,  personnel,  logistics,  force  development, 
etc.,  p.ople  may  be  more  aware  of  the  commander's  position  and 
more  responsive  to  his  needs.  You  require  his  support  and 
understanding.  !f  he  gives  you  the  "key  to  the  unit,"  your 
job  analysis  can  be  done  well.  If  he  resists  you,  you  will 

be  relegated  to  the  role  of  spy,  troublemaker,  etc. 

Remember,  however,  you  are  coming  to  him  with  the  support 
and  blessing  of  a higher  headquarters.  This  may  help  on  the 
surface--but  you  must  convince  the  Coninander  on  a one-to-one 
basis  and  get  his  genuine  and  sincere  cooperation. 

3.  Supervisory  personnel.  The  supervisor  of  the  people  whose  jobs 
you  are  analyzing  is  a key  person.  You  need  his  assistance  in 
selecting  job  incumbents  and  in  verifying  data  you  gather.  He 
needs,  also,  to  be  convinced  that  your  team  purposes  are 
honest  and  in  his  interest.  Generally,  you  can  get  his  support 
by  telling  him  exaccly  what  information  you  need,  exactly  why 
you  need  it,  what  you  are  going  to  do  with  it,  and  why  you 
need  his  help  in  making  the  program  a success.  Some  of  the 
details  or  examples  outlined  for  higher  level  commanders  might 
not  be  meaningful  to  him,  so  more  appropriate  examples  may  have 
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to  be  developed  for  his  briefing.  Remeirber  also  to  tell  him 
that,  when  you  are  looking  at  the  job  system  within  which 
his  people  work,  you  must  also  look  at  his  job  from  the 
point  of  view  of  what  influence  he  has  on  the  conditions 
of  the  job  Incumbent;  i.e.,  supervisory  assistance,  standards 
of  proficiency  and  how  he  enforces  them,  and  the  parts 
of  the  job  he  performs.  Be  sure  to  emphasize  to  him  that  you 
want  to  know  what  is,  as  well  as  what  Is  supposed  to  be. 

4.  The  job  incumbent  (job  holder).  The  job  Incumbent  is  going 
to  provide  the  real  meat  of  the  Job  analysis  data.  He 
is  doing  the  job,  He  knows  what  the  problems  are.  You 
need  to  get  information  from  him.  He  a full  ment)er  of 
t,,e  military  conmunity.  Tell  him  this.  Tell  him  why  you 
are  doing  the  survey  and  why  you  must  come  to  him.  Convince 
him  that  he  is  important,  because  he  is.  If  you  do  this 
effectively  and  assure  him  that  you  have  his  commander's 
and  supervisor's  sanction,  he  will  be  a real  source  of 
valuable  information.  Promise  him--and  del iver--feedback 
on  the  project  as  you  move  toward  action  to  solve  problems. 
Give  him  an  investment  and  a future  in  his  occupation  and 
his  branch.  Contributing  in  this  v;ay  to  "morale  and  welfare" 
can  be  a valuable  part  of  the  job  analysis  endeavor. 

At  the  same  time  that  you  are  preparing  briefings,  you  should  develop 


a schedule  for  conducting  the  data  collection.  A typical  schedule  is 
shown  in  Figure  1,9. 
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DAILY  SCHEDULE  FOR  CONDUCT  OF  COMMAND  JOB  ANALYSIS 

Note:  If  the  Comnand  Job  Analysis  Tcot  arrives 
after  noon  of  the  first  day,  then  the 
second  actual  day  at  a station  should  be 
considered  as  the  first  day. 

First  Day: 

1.  Comnand  Job  Analysis  Team  Briefing  for  Unit  Commander 

2.  Comnand  Mission  Briefing  for  Job  Analysis  Team 

3.  Tour  of  the  Facilities 

4.  Unit  Analysis  Interviews  with  Operations  Officer 

5.  Identification  of  Major  Work  Areas 
Second  Day: 

1.  Briefing  of  Staff  (including  discussion  of  interview  requirements) 

2.  Study  of  Nominee  Records 

3.  Selection  of  Job  Analysis  Participants 

4.  Study  of  Operations  Area  to  Identify  Environmental  Conditions 

5.  Briefing  of  Job  Holders  and  Others  to  be  Interviewed 

6.  Setup  of  Interviews 
Third  Day,  Foui tn  Day,  etc.: 

1.  Interview 

2.  Observation 

3.  Interview 

4.  Observation 

5.  Etc. 

Last  Day: 

1,  Continuation  of  Interviews/Observations 

2.  Exit  Briefing 

FIGURE  1.9:  Sample  Interview/Observation  Schedule 
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2.7.2  Select  Interviewees 

As  soon  a>  you  have  briefed  the  unit  comander  and  his  staff,  your  team 
must  brief  the  unit  staff  on  the  criteria  for  the  selection  of  Individuals 
to  be  Interviewed  and  observed.  The  criteria  were  outlined  in  Section  2.5 
of  tliis  block. 

Your  team  should  review  the  records  of  those  who  are  nominated  and 
select  for  participation  those  who  best  meet  the  criteria.  In  addition 
to  the  briefing  outlined  in  the  preceding  section,  meirisers  of  your  team 
also  should  review  the  briefing  with  the  participants  when  you  meet, 
individually,  in  their  work  areas.  This  is  where  the  real  motivation  can 
take  place.  These  meetings  should  reduce  or  eliminate  any  remaining 
anxiety  about  the  interviews/observations. 

2.7.3  Collect  Identifying  Information  ^ 

All  information  required  to  identify  a particular  job  analysis  report, 

to  fully  identify  the  unit  in  which  the  person  being  interviewed  works, 
and  to  present  background  information  about  the  man  himself  should  be 
recorded  on  the  background  information  form  you  prepared  in  Section  2.4, 

One  copy  should  be  completed  for  each  person  interviewed. 

2.7.4  Interviewing,  Observing,  and  Recording  Data 

In  conducting  interviews  with  the  job  incumbents  and  s,.pervisors, 
your  team  members  should  establish  a good  working  relationship  with  them 
before  attempting  to  collect  data.  The  briefings  mentioned  earlier 
should  have  done  most  of  this.  If  the  person  being  interviewed  still 
has  questions  about  his  role  in  the  interview,  answer  his  questions  as 
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honestly  as  you  can.  Be  sure  that,  when  the  actual  data  collection  gets 
tauler  way,  that  the  person  being  Interviewed  Is  the  one  to  describe  his 
duties  and  tasks  Do  not  tell  him  what  you  think  he  does;  let  him  tell 
you.  Get  at  the  specifics  of  the  Job  performance  and  record  the  data 
carefully.  Ask  questions  about  things  you  do  not  understand.  When  the 
interviewee  no  longer  can  give  pertinent  and  useful  information,  end  the 
interview. 

If,  in  Section  2.2,  you  decided  to  collect  only  task  inventory  infor- 
nation  on  the  first  visit,  let  the  interviewee  know  about  this.  Let  him 
know  you  will  be  coming  back  later  for  additional  information  about  sone 
of  the  tasks. 

Remember  that  the  job  incumbent  most  likely  performs  only  those  tasks 
assigned  to  him.  He  may  not  do  all  the  tasks  that  make  up  the  Job,  Diff- 
erent supervisors  split  up  work  activities  an»ng  the  workers  In  different 
ways.  Also  remember  the  job  holder  may  perform  some  tasks  Incorrectly, 

These  are  some  of  the  reasons  for  Interviewing  more  than  one  Job  holder 
and  for  also  interviewing  supervisors. 

When  your  team  members  observe  the  job  incumbents  performing  their 
duties  and  tasks,  be  sure  the  analysts: 

1.  observe  long  enough  to  witness  performance  of  all  tasks  that  the 
analysts  do  not  understand,  based  on  the  interview  information, 

2.  avoid  getting  in  the  way, 

3.  ask  questions  only  when  necessary,  and 

4.  make  careful  notes  of  observations. 
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While  It  is  essential  that  task  statements  be  specific,  unambiguous, 
and  have  the  same  meaning  to  all  who  will  use  the  information,  it  is  not 
essential  that  your  original  notes  and  statetnents  be  this  perfect.  During 
the  early  stages  of  job  analysis,  do  not  worry  about  the  size  of  the  group 
of  activities  you  call  tasks,  or  about  overlapping  and  duplicating  state- 
ments. Identifying  tasks  is  a process  that  requires  reviewing,  reexamining, 
and  rewriting  several  times.  Each  time  the  cycle  is  repeated,  the  resulting 
task  inventory  is  more  complete  and  accurate. 

You  probably  will  not  be  able  to  observe  the  job  incumbent  performing 
all  the  tasks  you  wish  to  observe. 


EXAMPLES 

1.  It  would  not  be  possible  to  schedule  the  fire 
fighter  to  "remove  a conscious  injured  person 
from  the  upper  floor  of  a burning  building." 

2.  "Destroy  enemy  submarine"  would  be  performed  only 
under  combat  conditions.  The  job  analyst  is  not 
likely  to  observe  the  performance. 

3.  While  a part  of  "correct  malfunctions  in  electronic 
equipment"  could  be  observed,  too  much  time  would 
be  required  to  observe  correction  of  all  possible 
mal functions . 


But,  for  those  tasks  or  parts  of  tasks  that  are  seldom  performed,  he  can 
use  indirect  methods  to  gather  the  necessary  job  information.  He  can  use 
descriptions  of  tasks  by  supervisors,  experienced  job  incumbents,  or  other 
experts,  and  analysis  of  such  information  sources  as  film  or  video  tape, 
The  procedure  must  be  systematic;  it  must  involve  verifying  the  job  task 
with  more  than  one  job  incumbent  and  with  more  than  one  supervisor. 
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The  output  of  this  section  1s  several  groups  of  job  information;  one 
group  of  information  from  each  interview  by  each  member  of  your  job 
analysis  team.  Each  group  of  Job  information  will  include  the  duties 
and  tasks  that  make  up  the  Job.  In  addition,  for  each  task  (or  for  each 
task  Selected  for  training,  if  your  data  collection  plan  called  for  coming 
back  later  for  details  of  the  tasks)  the  conditions,  initiating  cues, 
standards,  and  dements  will  be  listed.  Some  of  these  latter  iteits, 
particularly  the  elements  that  make  up  the  tasks,  may  already  be  docu- 
mented. This  means  you  will  need  only  to  find  the  documentation  and 
check  its  accuracy.  The  individuals  that  you  interview  will  be  excellent 
sources  for  both  locating  existing  documentation  and  checking  its 
accuracy.  Figure  1. 10  is  an  exainple  of  a portion  of  a properly 
documented  job  analysis. 

2.8  Consolidate  Data 

At  this  point  in  the  job  analysis, 
you  may  have  a large  number  of  lists  of 
duties,  tasks,  elements,  etc.  This 
information  probably  was  obtained  from 
a nuiiAier  of  individuals  at  several  loca- 
tions by  different  metibers  of  your  job 
analysis  team.  Now,  you  must  combine 
these  individual  job  analysis  reports 
into  one  master  report.  If  all  of 

thG  reports  are  basically  identical,  you  will  have  little  difficulty  in 
consolidating  the  data.  If  there  are  major  differences  between  some  of 
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FIGURE  I. 10;  Example  of  A Completed  Job  Data  Worksheet 
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the  lists,  your  decisions  will  be  considerably  more  difficult  to  make. 

You  may  need  to  use  additional  Subject  Matter  Experts  (SMEs)  to  resolve 
some  of  the  conflicts.  Management  decisions  may  have  to  be  mad-  to 
resolve  differences  in  the  Job  as  actually  performed  by  job  incumbents 
and  the  job  as  envisioned  by  their  supervisors.  You  may  have  to  recontact 
some  of  the  individuals  who  were  interviewed,  to  clarify  statements  or 
gather  new  information.  The  end  product  must  be  at  least  a tentative  con- 
solidated statement  of  the  overall  job. 

2.9  Verify  Task  Inventory 

As  you  will  note  on  the  flowchart  in 
Figure  1.5,  this  section  appears  to  be 
somewhat  out  of  sequence.  If,  in  Section 
2.2,  you  chose  the  on-site  interview  plan, 
this  section  is  no^what  you  should  do 
next.  Much  of  what  you  have  been  doing 
up  to  this  time  is  collecting  data  and 
constructing  a task  inventory  or  list. 

One  reason  you  chose  the  on-site  interview 
plan  was  because  you  did  not  already  have  available  a good  task  inventory. 
If  you  had,  you  might  have  chosen  the  survey  plan  instead.  The  first 
step  in  the  survey  plan  is  to  verify  the  task  inventory.  After  that, 
the  two  plans  are  basically  similar,  Therefore,  we  will  pause  here  to 
discuss  verifying  the  task  inventory,  and  then  we  will  continue  to 
discuss  the  remaining  steps  for  both  plans. 


llllJlIlllllllMUli'lMK 
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How  iwich  effort  needs  to  be  pu'  Into  verifying  en  existing  task 
inventory  depends  upon: 

1.  the  complexity  of  the  particular  job, 

2.  when  the  existing  task  inventory  was  made  or  when  it 
was  last  updated, 

3.  how  mi  ch  the  particular  job  is  likely  to  change  over 
time,  and 

4.  the  basis  for  the  existing  task  inventory:  what  method 
was  used  to  collect  the  information. 

in  the  next  several  sections,  you  will  be  sending  your  task  inventory 
to  a large  number  of  people.  A considerable  amount  of  time  and  money 
will  be  spent  finding  out  more  about  the  tasks  on  your  Inventory.  There- 
fore, you  want  to  take  all  reasonable  steps  to  make  sure  the  list  is  as 
accurate  as  practical  before  you  send  it  out  to  possibly  hundreds  of  people. 

Probably  the  best  way  to  verify  the  existing  task  inventory  is  to  use 
the  Jury -of -Experts  approach.  This  method  is  discussed  in  Section  2.2  of 
this  block. 

The  primary  concern  of  the  verifying  process  is  to  make  sure: 

1.  all  tasks  performed  by  all  levels  of  personnel  who  do 
the  job  are  included  in  the  task  list,  and 

2.  the  task  statements  are  worded  so  that  individuals  surveyed 
for  additional  information  will  understand  what  is  meant 

by  the  statements. 
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2.10  Prepare  Survey  Questionnaires 

The  information  you  gather  with 
the  survey  questionnaire  may  be  massive, 
repetitive,  and  could  in  some  cases  be 
stored  in  a computer  for  ease  of  manipu- 
lation and  retrieval.  Whether  or  not  a 
computer  is  used,  you  should  know  just 
what  kinds  of  data  you  will  need  and 
where  the  data  will  be  used.  Collecting 
useless  data  and  storing  it  in  a form  that  cannot  be  used  are  cotmon 
problems  arising  when  the  data  purposes  are  not  understood.  The  type  and 
quantity  of  collected  data  should  be  determi.ied  by  your  specific  needs. 

The  next  several  steps  deal  with  making  sure  beyond  any  reasonable 
doubt  that  your  task  list  correctly  reflects  the  real-world  job.  You 
are  going  to  accomplish  this  by  sending  questionnaires  to  a large  number 
of  people  who  know  about  the  job  and  by  reviewing  the  returned  data 
to  see  if  they  verify  the  accuracy  of  your  task  list.  This  is  called 
val idating  the  task  inventory.  The  first  step  is  to  design  the 
questionnaire  for'ms. 

The  details  of  the  forms  you  use  will  be  determined  by: 

1.  how  you  will  tabulate  and  summarize  results,  and 


2,  what  information  you  wish  to  collect. 


How  you  will  tabulate  and  sunmarize  results  will  be  determined  by 
whether  you  have  available  a computer  and  other  automated  data  handling 
equipment  and  by  the  number  of  people  to  be  surveyed.  To  determine  what 
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information  you  wish  to  collect,  you  should  first  consider  what  information 
you  need  to  collect  to  meet  the  requirements  of  this  block.  These  data 
requirements  are: 

1.  Identifying  information  about  the  individuals  being  surveyed 

2.  Identifying  tasks  that  are  on  the  task  list  but  are  not 
performed 

3.  Listing  any  tasks  that  are  performed  but  are  not  on  the 
task  list 

4.  Identifying  any  task  statements  that  are  incorrectly  stated, 
and  recommending  revisions 

In  addition  to  the  above,  you  may  wish  to  collect  information  such  as: 

1.  Data  needed  to  detennine  which  tasks  will  be  selected  for 
training 

2.  Other  management  data  that  can  be  economically  collected 
with  the  same  survey 

You  will  remember  that  we  said  earlier  that  you  probably  would  want  to 
collect  at  least  part  of  the  data  required  for  Block  1.2  at  the  same  time 
and  with  the  same  questionnaires  you  use  to  collect  data  for  this  block. 
Block  1.2  will  help  you  detemine  what  kind  of  information  you  will  need 
to  make  decisions  on  which  tasks  to  select  for  training. 

Other  management  information  olten  can  be  collected  economically  on 
the  same  survey  forms  as  those  required  for  the  data  in  this  block.  While 
details  of  such  management  information  is  outside  the  scope  of  this  model, 
onr  possible  example  is  as  follows. 
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EXAMPLE 


Management  might  wish  to  know  which  tasks  are  being 
performed  by  individuals  with  an  eig'>th  g'ade  educa- 
tion and  which  tasks  are  being  performed  cy  individ- 
uals with  a high  school  education.  If  onth  groups 
were  found  to  perform  the  same  tasks,  management 
might  wish  tc  reduce  the  enLiy  rcqui re!"en ts  for  that 
particular  job. 


One  note  of  caution  about  the  design  of  your  questionnaire  ’s  that  you 
should  keep  the  questionnaire  as  short  as  practical.  In  general,  the  fornii 
should  be  designed  so  they  can  be  completed  in  two  hours  or  less.  One  way 
you  can  save  time  on  a complex  task  inventory  is  list  all  tasks  under  their 
appropriate  duty  title.  This  will  permit  the  interviewees  to  rapidly  scan 
groups  of  tasks  that  he  does  not  perfo?*m  and  then  proceed  to  the  next  duty. 


EXAMPLE 


A mechanic  who  works  full-time  in  the  shop  knows  without 
reading  them  that  none  of  the  tasks  under  the  duty  head- 
ing, "Performing  engine  conditioning  on  the  light  line,"' 
apply  to  him. 


A sample  form  for  collecting  identifying  information  v^as  shown  in 
Figure  1.7.  Appendices  C and  D,  pages  100-104,  are  examples  of  forms  that 
might  be  used  to  collect  data  for  validating  the  task  list.  (Both  forms 
also  include  some  information  for  making  training  decisions.  This  will 
be  discussed  in  the  next  block.)  The  forms  in  Appendix  C are  for  hand 
recording  infor-mation,  while  those  in  Appendix  D are  for  machine  recording 
and  summarizing. 
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In  addition  to  the  preceding,  you  also  will  need  to  prepare  detailed 
instructions  for  completing  and  administering  the  questionnaires.  An 
exan^le  of  such  instructions  is  included  in  Appendix  E,  page  106. 

2.11  Select  Survey  Sample 

As  a general  rule  your  survey  sample  should 
Le  as  large  as  possible.  This  is  particularly 
true  if  you  do  not  have  personnel  available 
with  the  responsibility  and  authority  to  assure 
that  most  of  your  questionnaires  will  be  com- 
pleted. With  appropriately  designed  question- 
naires, computer  programs  can  easily  analyze 
returns  from  thousands  of  individuals. 

The  first  step  in  determining  the  individuals  to  be  surveyed  is  to 
find  out  the  total  number  of  people  in  the  service  being  surveyed 
who  are  assigned  to  the  particular  job  being  analyzed.  Personnel  offices 
of  each  service  maintain  such  records.  An  attempt  should  be  made  to 
obtain  a sample  of  at  least  3000  individuals.  If  there  are  fewer  than 
3000  individuals  available,  a 100  percent  sample  should  be  used.  If  more 
than  3000  are  assigned  to  a job,  those  selected  for  the  survey  should 
be  representative  of  the  whole. 

You  should  make  an  attempt  to  obtain  a sample  that  represents  the 
distribution  of  individuels  in  the  job  according  to  command  and  skill 
level  as  it  exists  in  the  service.  By  using  representative  samples, 
the  survey  results  can  be  interpreted  as  reflecting  an  accurate  picture 
of  the  job  as  a whole.  Review  of  personnel  records,  either  by  personnel 
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employees,  members  of  your  job  analysis  team,  or  your  field  representatives 
who  will  conduct  the  survey,  will  be  required  to  obtain  data  upon  which 
to  base  choices  for  your  survey.  Section  2.5  of  this  block  gave  guidelines 
for  selecting  Individuals  for  interviews.  These  same  guidelines  are 
suitable  for  selecting  your  survey  sample. 


2.12  Conduct  Questionnaire  Survey 

Before  sending  out  the  total  number 
of  questionnaires  you  intend  using,  you  may 
wish  to  first  send  out  a small  number.  This 
will  permit  you  to  check  the  initial  results 
and  possibly  make  some  changes  in  your  question- 
naires or  instructions.  Then  you  will  send  out 
what  you  hope  will  be  the  total  number  of 
questionnaires  required. 

The  ideal  way  to  administer  questionnaires  is  group  administration. 
Where  the  local  responsible  official  and  his  assistants  schedule  the- 
adtiini  strati  on,  make  certain  that  only  eligible  individiials  are  seated  in 
the  administration  area,  read  the  administrative  directions,  and  provide 
any  necessary  assistance  in  completing  the  questionnaires.  The  local 
official  then  returns  the  completed  questionnaires  to  the  sending  authority. 

Often,  particularly  with  individuals  at  remote  stations,  group  adminis- 
tration is  impractical.  In  these  cases,  it  is  sometimes  effective  to 
send  the  questionnaires  to  a responsible  officer  and  request  that  he  return 
them  by  a reasonable  suspense  date.  Careful  attention  should  be  paid  to 
the  instructions  for  administration  or  self-administration.  If  the  sending 
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coninand  has  no  authority  to  require  that  a suspense  date  be  met,  they  imist 
either  obtain  the  concurrence  of  a command  with  that  authority  or  be 
willing  to  accept  a reduced  percentage  return. 

Hew  much  confidence  can  you  have  in  the  validity  of  your  questionnaire 
If  you  get  less  than  a 100  percent  return?  Less  and  less  confidence  can 
be  expected  with  each  reduction  in  the  percentage  returned.  However, 
if  you  only  intend  to  use  the  questionnaires  to  find  out  whether  the 
Individuals  perform  the  tasks,  you  will  be  able  to  tolerate  a lesser 
percentage  then  If  you  Intend  to  collect  all  useful  information  from 
your  respondents.  If  your  questionnaires  are  highly  reliable  (that  is. 

If  most  respondents  tell  you  pretty  much  the  same  thing  regardless  of 
specific  location  or  command),  you  can  have  more  confidence.  For  example, 
if  all  your  questionnaires  came  from  shore  stations  and  half  your  DOS 
is  at  sea,  you  would  have  much  less  confidence  in  the  validity  of  the 
results.  Your  confidence  can  increase  as  the  spread  of  returns  covers 
all  important  stations,  locations,  missions,  and  levels  of  the  D0.S. 

What  can  you  do  if  you  are  not  satisfied  with  the  percentage  of  returns 
of  the  questionnaires?  You  can  send  out  wore  forms  to  different  people 
and  hope  for  better  results;  you  can  recontact  some  of  the  first  sample 
and  try  to  encourage  them  to  return  the  questionnaires;  and  you  can  visit 
a random  sample  of  those  who  did  not  ►'espond  and  compare  their  forced 
responses  with  the  voluntary  responses.  T.hen  y'ou  and  y'our  supervisors 
will  have  to  decide  how  much  chance  you  are  willing  to  take  that  the 
data  you  have  received  presents  a sufficiently  accurate  picture  of  the 
job  as  it  really  exists. 
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2.13  Revise  Job  Data  as  Required 

Evaluation  of  the  survey  data  collected 
In  the  above  block  will  show  that: 

1.  Your  task  list  was  perfect;  everyone 
agreed  with  it  100  percent.  Or, 

2.  At  least  some  individuals  indicated 
at  least  some  discrepancies  in 
your  task  list. 

If  your  task  list  was  considered  perfect, 
you  are  ready  to  move  on  to  the  next  section  of  this  block.  However,  most 
likely  someone  somewhere  disagreed  with  you.  The  area  of  disagreement 
could  be  any  or  all  of  the  following: 

1.  Some  tasks  on  your  list  should  be  deleted. 

2.  You  left  off  some  tasks.  Some  new  ones  need  to  be  added. 

3.  Some  of  the  tasks  you  listed  were  incorrectly  stated  and 
should  be  rewritten. 

4.  Some  duty  statements  were  incorrectly  listed,  or  some 
tasks  were  listed  under  the  wrong  duty. 

Since  these  four  items  probably  represent  most  of  the  probable  changes, 
this  section  will  discuss  how  to  deal  with  each  discrepancy. 

First,  even  if  practically  everyone  said  certain  tasks  should  be 
deleted,  you  should  be  hesitant  to  do  so.  At  this  point  it  is  better  to 
Include  tasks  that  individuals  disagree  on  rather  than  to  exclude  them. 
These  tasks  would  not  be  listed  in  the  first  place  if  someone  somewhere 
did  not  consider  the  disputed  tasks  a part  of  the  job.  One  exception  to 
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this  is  if  you  have  listed  two  or  more  task  statements  that  are  actually 

the  same  task.  In  this  case,  you  will  want  to  delete  all  but  one  of  the 

task  statements  and  possibly  restate  the  remaining  one. 

Item  2 on  the  preceding  page  is  a more  serious  matter.  You  want  to 

be  sure  not  to  exclude  any  tasks  that  are  a legitimate  part  of  the  job. 

If  the  suggested  new  task  clearly  is  not  a part  of  the  job,  you  should 
reject  the  suggestion  that  you  include  it.  An  example  of  this  is; 


EXAMPLE 


A postal  clerk  claims  some  tasks  ttiat  should  be  added 
are  "replace  burned-out  light  bulbs"  and  "repair  truck 
used  to  deliver  mail."  While  you  cannot  deny  the  possi- 
bility that  Some  postal  clerk  somewhere  actually  performs 
these  tasks,  neither  task  has  any  relationship  to  the  job 
of  postal  clerk. 


The  tasks  in  the  above  example  are  parts  of  other  jobs,  and  unique 
circumstances  sometimes  require  an  individual,  at  least  temporarily,  to 
do  part  of  someone  else's  job.  You  should  not  include  such  tasks  in 
your  list. 

However,  if  as  many  as  perhaps  5 percent  of  the  respondents  indicate 
that  a certain  task  should  be  added,  if  these  individuals  are  fairly 
representative  geographically,  and  if  the  nature  of  the  task  is  such 
that  it  could  be  a part  of  the  job,  you  probably  should  include  it. 
Remembe,-  that  if  the  task  is  relatively  insignificant,  it  probably  will 
be  screened  out  in  Block  1.2;  SELECT  TASKS/FUNCTIONS. 

The  same  general  statements  as  above  can  be  made  for  suggestions  that 
certain  tasks  or  duties  are  incorrectly  stated  or  that  certain  tasks  are 
listed  under  the  wrong  duty.  Remember  that,  since  you  have  identifying 
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information  from  each  respondent,  you  can  recontact  him  In  person,  by 
telephone,  or  by  correspondence.  You  can  determine  if  his  information 
is  correct  and  base  your  decisions  partly  on  the  credibility  of  the 
respondents. 

In  the  final  analysis,  the  consolidated  li.st  should  be  acceptable 
to  you  and  your  cormiand.  While  this  does  not  mean  you  should  make 
arbitrary  decisions,  it  does  mean  you' may  not  be  able  to  completely 
please  everyone.  Document  the  decisions  you  are  forced  to  make,  give 
the  reasons  for  your  decisions,  and  move  on  to  the  next  block, 

2.14  Collect  Other  Required  Job  Information 

In  Section  2.2  of  this  block,  when 
you  developed  your  data  collection  plan, 
you  made  a decision  as  to  whether  your 
initial  data  collection  effort  would  be 
restricted  to  developing  and  validating 
a task  inventory  or  if  you  would  initially 
collect  all  required  job  information.  If 
you  made  the  latter  decision,  you  will  now 
have  most  of  the  conditions,  initiating  cues, 
standards.^  and  elements  for  each  task.  However,  if  you  have  not  yet 
collected  this  data  or  if  you  added  nev;  tasks  in  Section  2.13,  you  will 
need  to  continue  with  your  job  analysis  effort.  If  you  decided  to  select 
tasks  fOr  training  in  Block  1.2,  and  then  collect  the  additional  data  only 
for  tasks  selected  for  training,  you  will  need  to  complete  the  procedures 
in  Block  1.2  and  then  come  back  to  this  point  in  this  block, 
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Regardless  of  >our  original  plan  and  what  you  have  done  up  to  this 
point  you  will  need  thorough  documentation  of  conditions,  initiating  cues, 
standards,  and  elements  for  each  task  or  at  least  for  each  task  selected 
for  training.  While  there  are  several  possible  ways  to  accomplish  this, 
there  is  only  one  reroninended  way:  Follow  the  steps  outlined  in  bections 

Z..1  - 2.8  for  on-sitc  interview  collection  of  data. 

If  you  still  have  to  collect  all  of  the  required  information  about 
eaLh  task,  this  represents  a sizable  effort.  If  you  have  most  of  the  data 
but  have  added  several  new  tasks,  the  remaining  effort  will  be  a minor  one. 
If  all  the  required  conditions,  standards,  elements,  and  such  information 
still  must  be  collected,  at  least  you  already  have  a good  task  list; 
and  if  you  have  selected  tasks  for  training,  you  do  not  have  as  many 
tasks  with  which  to  work. 

When  you  complete  this  final  effort,  you  are  ready  to  check  the  formal 
documentation  requirements  of  3.0  of  this  block  and  then  n»ve  on  to 
Block  1.2  (or  1.3  if  you  have  already  selected  tasks  for  training). 


2.15  Carry  Out  Alternate  Data  Collection  Plan 
In  Section  2,2,  we  mentioned 
that  you  might,  because  of  some 
situations  or  constraints,  develop  j 

some  data  collection  plan  for  an  j 

existing  job,  other  than  the  two  ’ 


major  plans  we  have  emphasized. 
Two  major  reasons  for  an  alter- 


nate choice  were: 
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1,  Only  relatively  minor  changes  have  been  made  in  the  job. 

The  extent  of  the  changes  does  not  justify  extensive 
on-site  interviews  and  questionnaire  surveys, 

2.  Time,  cost,  or  other  management  constraints  dictate  that 
you  accept  a less-than-ideal  approach. 

For  the  first  situation,  or  other  similar  situations,  a Jury-of- 
Experts  or  the  group  interview  approach  might  have  been  chosen.  Following 
this  with  a small  questionnaire  survey  should  give  good  assurance  that 
your  data  is  essentially  correct. 

If  the  second  situation  is  your  reason  for  developing  an  alternate 
plan,  we  cannot,  of  course,  argue  with  your  doing  the  best  you  can  with 
what  you  have  tn  work  with.  However,  if  you  cannot  afford  to  follow  the 
recomnenoed  procedures,  your  probability  of  obtaining  good  results  is 
considerably  reduced.  Our  only  suggestion  here  is  that,  if  you  cannot 
follow  the  recomaended  procedures,  the  credit--or  blame--for  the  result- 
ing training  program  should  not  be  laid  on  the  recommended  procedures! 


2.16  Analyze  New  Job 

If  the  job  you  are  analyzing  is 
a new  job  (that  is,  no  one  does  the  job 
now),  most  of  the  analysis  techniques  we 
have  discussed  so  far  will  be  of  little 
assistance  to  you.  Conducting  on-site 
interviews  with  or  sending  questionnaires  to 
individual  job  incumbents,  or  holding  group 
interviews  with  job  incumbents  can  be  useful 
only  to  the  degree  that  the  new  job  resembles 
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a job  that  already  exists. 
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For  the  new  job,  you  may  initially  have  no  job  data  ai.  all.  And  you 
may  have  no  opportunity  to  see  the  job  in  actual  operati,,i.  But  in  spite 
uf  these  limitations,  it  still  may  be  necessary  to  have  a training  course 
ready  in  time  to  begin  training  before  the  new  system  or  equipment  is  put 
into  operation. 

Ideally,  as  jobs  are  envisioned  as  part  of  a new  operational  concept 
or  of  new  equipment  systems,  the  jcb  analysis  teams  are  notified;  and  they 
become  a part  of  the  development  activity.  In  this  way  the  required  work 
activities  within  the  new  systeiti  can  be  documented  and  translated  into 
job  analysis  data  as  the  system  develops.  This  serves  in  two  important 
ways: 

1,  If  the  system  concept  is  developing  a "people"  requirement 
that  is  impossible  to  fulfill,  this  fact  can  be  announced 
and  the  system  can  be  modified. 

2.  The  documented  job  analysis  data  can  be  the  basis  for 
training  programs  that  will  develop  graduates  to  coincide 
with  the  introduction  of  the  new  system  in  the  field. 

This  also  increases  the  likelihood,  in  the  equipment-oriented 
areas,  of  early  introduction  of  the  equipment  into  the 
training  program. 

Regardless,  however,  of  the  point  in  time  that  you  .-'’come  involved 
in  the  new  program,  the  data  collection  method  you  use  will  be  largely 
determined  by  whether  the  new  job  to  be  analyzed  is  equipment-oriented 
or  non-equipment  oriented.  And  one  essential  resource  that  you  have 
on  your  team  is  the  Subject  Matter  Experts  (SMEs)  in  systems  or  equipment 
similar  to  that  involved  with  the  new  job  you  are  analyzing. 
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2.16,1  Non-Equipment"Oriented  Jobs 


The  beginning  point,  when  analyzing  a new  non-equ1ptnent-or1ented 
job,  Is  to  rs'/lew  the  available  Information.  Since  a management 
decision  has  been  made  to  establish  the  new  Job--otherw1se,  you  would 
not  have  been  assigned  to  analyze  it--someone,  somewhere  has  at  least 
a general  idea  of  what  the  new  job  will  be  like.  Most  likely  this 
information  is  documented  and  available  for  your  use.  Analysis  of 
this  information  may  show  the  new  job  to  be  a regrouping  of  a variety 
of  tasks  that  are  presently  being  performed  in  other  closely  related 
jobs,  with  Some  new  tasks  added. 


EXAMPLES 

1.  A new  job  of  Stock  Control  and  Accounting  Specialist 
might  include  many  tasks  presently  performed  by 
Automotive  Repair  Parts  Specialists,  Aircraft  Repair 
Parts  Specialists,  and  Communications-Electronics 
Repair  Parts  Specialists.  The  new  tasks  might  be 
operation  and  control  of  a computer-managed  inventory 
control  system. 

S.  A new  job  of  Infafitryiiidn , On  Leash  Scout  Dog  Handler 
might  include  most  of  the  same  tasks  performed  by  other 
Infantrymen,  but  in  addition  it  includes  scout  dog 
handling  and  dog  obedience  training. 


Once  you  identify,  at  least  tentatively,  the  tasks  that  are  already 
performed  in  similar  jobs,  you  can  analyze  that  part  of  the  new  job  by: 

1.  locating  and  reviewing  existing  job  analysis  data  for  those 
tasks,  or 

2.  if  the  above  documentation  does  not  exist,  is  incomplete,  or 
' is  outdated,  conduct  on-site  interviews  with  individuals  who 

perform  and  individuals  who  supervise  the  tasks. 
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For  the  new  tasks,  you  will  have  to  look  further  for  appropriate  infor- 
mation. Most  likely  you  will  find  that  similar  tasks  are  performed  some- 
where by  someone.  Very  few  things  in  the  world  are  completely  new.  You 
will  have  to  gather  data  for  the  new  tasks  from  the  best  available  sources: 
other  services,  other  government  agencies,  or  private  industry.  You  and 
your  Subject  Matter  Experts  (SMEs)  may  have  to  make  some  assumptions 
about  the  tasks  that  may  later  prove  to  be  wrong.  In  any  case,  your 
data  will  not  be  totally  valid  until  analysis  is  done  on  the  Job  after 
the  operation  begins. 

1 

2. IS. 2 Equipment-Oriented  Jobs 

The  armed  services  rarely,  if  ever,  can  afford  to  wait  until  new 
equipment  arrives  before  beginning  training  for  use  and  maintenance  of  the 

new  equipment.  j 

EXAMPLE 

When  the  new  B1  Bombers  arrive,  or  very  shortly 
thereafter,  someone  must  be  trained  to  fly  them, 
someone  must  be  able  to  operate  the  new  electronic 
equipment,  and  someone  must  be  trained  to  maintain 
the  bomber  and  all  its  equipment. 

Most  new  or  advanced  systems  are  really  the  second  or  third  generation 
of  existing  equipment.  New  jobs  such  as  operating  or  maintaining  the  new 
equipment  arc  comewhat  similar  to  operating  or  ma'intalning  the  old  equip- 
ment. Data  obtained  for  jobs  on  the  old  equipment  can  be  used  as  a basis 
f>r  analyzing  the  new  job.  Analysis  of  an  equipment-oriented  job  depends 
heavily  on  a clear  understanding  of  the  new  equipment.  This  is  the  major 
reason  for  having  ShCs  on  your  team  who  are  thoroughly  familiar  with  sitMlIar 
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equipment.  They  are  much  more  likely  to  understand  how  the  new  equipment 
is  different  and,  thus,  how  the  tasks  that  maKe  up  the  new  Job  will  be 
different. 

In  some  cases,  you  can  gather  data  from  parallel  work  being  done  for 
other  purposes. 


EXAMPLES 

1.  An  equipment  contractor  usually  collects  data  for 
engineering  validation  of  his  equipment  prior  to 
production.  These  validation  data  often  contain 
information  applicable  to  the  new  equipment-oriented 
job  you  are  analyzing. 

2.  When  the  contractor  begins  testing  prototype 
equipment,  there  should  be  opportunity  for  the  job 
analyst  to  bring  appropriate  military  subjects  to 
the  factory  site  and  let  them  sit  in  on  the  tests. 

The  use  of  the  typical  military  operator  would 
certainly  be  beneficial  to  the  contractor  in  his 
tests  and  would  provide  an  opportunity  for  the  job 
analyst  to  observe  and  document  job  performance 
requi remen ts . 

3.  Observation  of  assembly  techniques  on  the  contractor's 
assembly  line  and  observation  of  final  equipment 
check-out  procedures  can  provide  data  on  operation 
and  maintenance  of  the  equipment. 


Sometimes  simulation  may  be  used  to  obtain  critical  information. 

At  other  times,  you  and  your  SMEs  will  have  to  "think  through"  the  tasks 
in  an  attempt  to  deHne  or  predict  the  required  behavior  of  the  man  on 
the  job  who  will  use  the  equipment.  Your  team  must  obtain  as  much  early 
task  data  as  possible,  and  you  must  be  willing  to  change  the  task  list 
as  more  daca  become  available.  Even  at  best  you  will  end  up  with  incom- 
plete information.  Tne  more  cornplex  the  equipment,  the  more  errors  are 
likely  to  occur  in  your  job  analysis. 


As  with  analysis  of  existing  Jobs,  the  analysis  of  a new  Job  should 
result  in  a list  of  tasks  that  make  up  the  Job  as  well  as  the  conditions, 
initiating  cues,  standards,  and  elements  that  make  up  each  task.  However, 
as  we  noted  earlier,  the  data  for  this  new  Job  will  not  be  totally  valid 
until  analysis  is  done  on  the  job  after  the  new  equipment  is  pui;  Into 
use.  Typically,  there  is  at  least  a 25  percent  change  in  the  new  job 
after  the  first  year  of  operation. 

3.0  OUTPUTS 

Completion  of  the  procedures  discussed  in  this  block,  and  in  all  the 
other  blocks  in  the  model,  will  result  in  several  tangible  products.  Thes 
products  are  a result  of  what  you  did  in  each  block  of  the  ISO  model.  In 
addition  to  these  products,  another  very  critical  part  of  the  ISO  process 
Is  the  formal  documentation  of  significant  decisions,  activities,  and 
problems  produced  or  encountered  in  each  block  of  the  model.  Not  only 
what  you  did,  but  also  why^,  when,  and  hw  you  did  it  are  important  and 
must  be  documented.  SOine  reasons  for  this  formal  documentation  are: 

1.  You  need  to  show  your  supervisor  and  others  what  you  plan  to 
do  and  why,  when,  and  how  you  intend  doing  it.  And  then,  as 
you  carry  out  the  plan,  you  need  to  report  on  your  progress 
to  your  supervisors  and  others.  They  are  responsible  for 
nonitoring  your  performance.  For  them  to  do  this,  they  must 
have  adequate  inputs  from  you. 

2.  If  you  end  up  producing  exceptionally  good--or  exceptionally 
poor--training,  others  involved  in  developing  training  have  a 
right  to  know  how  you  did  it.  Over  a period  of  time,  you 
are  going  to  forget  many  things;  you  need  to  document  as 

you  go  along. 
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3.  A inajor  factor  in  deciding  whether  soi..eone  eise's  training 
program,  the  use  of  which  would  result  in  considerable 
savings,  is  suitable  for  your  needs  is  understanding  how 
the  program  was  developed.  How  did  they  develop  tests? 

Is  it  the  same  way  you  would  have  done  it?  Or  did  they 
do  it  better  than  you  would  have?  What  criteria  did  they 
use  to  select  tasks  for  training?  Was  their  criteria 
similar  to  what  you  think  is  important?  How  did  they 
validate  their  program?  How  did  they  go  about  analyzing 
the  job?  These  are  just  a sample  of  questions  for  which 
you  would  need  answers  before  you  adapted  someone  eise's 
program  to  meet  your  training  needs.  Remember,  if  you 
want  these  kinds  of  information  from  others,  you 
should  be  willing  to  provide  it  for  courses  you  develop. 

4.  The  ISD  process  is  a repetitive  process  in  that  what  you 
do  or  what  happens  in  one  block  may  require  you  to  go  back 
and  do  some  things  differently  in  earlier  blocks.  If  you 
iiave  not  documented  huw  you  did  it  the  first  time,  you 
may  not  know  how  to  do  it  differently  the  next  time. 

5.  A number  of  individuals  are  generally  involved  in  an  ISD 
effort  to  develop  a single  course  of  instruction.  You  may 
do  only  the  job  analysis  and  then  turn  the  program  over  to 
another  group.  In  order  to  continue  with  the  orderly  develop- 
[iiLiit  of  the  program,  each  new  individual  or  group  needs  to 
know  not  only  exactly  what  has  been  done  before  but  also  why 
and  how  i t was  done. 
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The  total  output  of  eacn  block,  then,  is  both  the  product  that  the 
procedures  are  designed  to  produce  and  the  formal  documentation  pre- 
pared, while  carrying  out  these  procedures,  that  permits  others  to  under- 
stand the  series  of  decisions  and  events  that  shaped  your  final  products. 

A list  will  be  given  at  the  end  of  each  block  of  this  total  output 
required  from  that  block. 

The  outputs  of  Block  I i;  ANALYZE  JOB  should  consist  of  the  following: 

3.1  Products 

1.  Definition  of  the  job  (See  example,  page  86.) 

?.  A validated  task  list  (See  example,  page  86.) 

3.  Conditions,  cues,  standards,  and  elements  for  each 
task  (See  Figure  I II  for  an  example.) 

3.2  Other  Documentation 

1.  Statement  of  rationale  for  conducting  a job  analysis 

2.  Details  of  data  collection  plan,  including  rationale  for 
the  plan  and  scheduled  completion  dates  for  each  major 
step  in  the  plan 

3.  Details  of  actual  data  collection.  These  should  include: 

a.  Any  deviation  from  the  plan  and  reasons  for  the 

deviations 

b.  Copy  of  questionnaires 

c.  Sumtiary  statement  of  questionnaire  results 

4.  Any  other  pertinent  job  analysis  information  not  included 
in  the  above 
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EXAMPLE 


Definition  of  the  Job: 

The  job  of  an  OH-58  Helicopter  Repairman  Includes 
Inspecting,  testing,  servicing,  adjusting,  calibrating, 
Installing,  replacing,  repairing,  overhauling,  and 
rebuilding  any  or  all  components  of  the  OH-58  helicopter. 


EXAMPLE 

Validated  task  list: 

A.  Service  oil  system-main  transmission. 

1.  Inspect  main  transmission  oil  system, 

2.  Perfonii  maintenance  operational  check  on 
transmission  oil  system. 

3.  Troubleshoot  transmission  oil  system. 

B.  Install  main  transmission. 

1.  Install  main  rotor  swash  plate. 

2.  Install  main  rotor  swash  plate  support 
assembly, 

3.  Install  main  rotor  hub. 

4.  Repair  main  rotor  pitch  link  assembly. 


JOB  DATA  WORKSHEET 
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APPENDIX  A 


EXAMPLE  OF  DOCUMENTATION  OF  TASK  CONDITIOf^ 

/ 

Job:  Manual  Central  Office  Repairman  (MOS  36fi20) 

Task:  Troubleshoot  Telephone  Set  TA-312/PT. 

Job  Task  Conditions:  See  Standard  job  task  conditions,  level  II.  In 

particular,  repairman  uses  TM  11-5805-201-35,  Tool  Equipment  TE-49,  a 
second  Telephone  TA-312/PT,  and  two-conductor  wire  to  perform  checks. 

Job  Task  Standards:  TM  11-5805-201-35,  paragraph  3-3,  outlines  accurate 
standards;  experienced  repairman  requires  20  minutes  or  less  to  complete 
checks. 

-Standard  Job  Task  Conditions:  Manual  Central  Office  Repair,  MOS  35G20 

Level  I - Organizational  Maintenance 

1.  General.  Organizational  maintenance  is  performed  at  the  location  where 
manual  central  office  telephone  equipment  is  Installed  or  stored,  It  con- 
sists of  checks  and  services  performed  at  scheduled  intervals,  following 
procedures  outlined  in  technical  manuals.  It  also  includes  limited  trouble- 
shooting, pluckout  parts  replacement,  and  minor  adjustments  as  authorized  in 
pertinent  maintenance  allocation  charts.  Specified  maintenance  forms  are 
completed  during  maintenance. 

2.  Tools,  equipment,  and  clothing:  Tools  and  equipment  specified  in  tool 
allocation  charts  are  used  or  their  equivalents  contained  in  specific  TOE. 

No  special  clothing  is  required. 
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3.  Job  aids  and  manuals.  Ther  pertinent  equipment  technical  manuals  are 
always  available  and  other  publications  referenced  in  technical  manuals 
are  usually  maintained  by  each  organisation. 

4.  Environment.  Nonnally,  organizational  maintenance  is  perfnnned  under 
protective  shelter,  but  occasionally  repairs  are  performed  outside.  Gloves 
and  heavy  clothing  may  hinder  performance  during  cold  weather.  Required 
power  may  be  provided  by  batteries,  portable  generators,  or  commercial 
faci 1 i ties . 

5.  Special  physical  demands.  Outside  repairs  are  performed  in  hot,  cold, 
or  v/et  weather  conditions.  Emergencies  may  require  longer  workdays  than 
the  twelve  hours  nonnally  required  in  combat  zones.  All  tools,  test 
equipment,  and  spare  parts  must  be  iicved  to  <"he  equipment  being  repaired. 

6.  Supervision  and  assistance.  Usually  available  for  newly  assigned 
job  holders. 

Level  II  - Direct  Support  (DS)  Maintenance  Shop 
1.  General.  OS  maintenance  may  be  performed  in  a sheltered  AN/MSM-,16 
portable  shop  that  houses  necessary  test  equipment,  replacement  parts, 
required  power  connections,  and  a workbench  area  suitable  for  two 
repairmen.  Maintenance  up  to  and  including  piece-part  repair  is  per- 
formed on  major  items,  assemblies,  and  subassembles.  Operator 
preventive  maintenance  is  also  performed  on  test  equipment. 


2. 


Tools  and  test  equipment. 
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a.  In  addition  to  Items  nonnally  mounted  In  shelter,  Test  Set  TS-140/PCM^ 
MuHimeter  TS-352/U,  Test  Set  TS-716/U,  Electron  Tube  Test  Set  TV-7/U, 

Test  Set  .-181,  Test  Set  TS-183/U,  Tool  Equipment  TE-49,  and  special 
telephone  repair  tool  kits  are  included  in  each  shelter. 

b.  All  portable  test  equ1pi%nt  is  used  both  in  the  shelter  and  for 
onsite  repairs  after  which  it  is  returned  to  the  shelter, 

3.  Job  aids  and  manuals.  A minimum  of  two  sets  of  technical  manuals  for 
most  manual  central  office  telephone  equipment  is  available  in  each  DS 
shelter. 

4.  En«^ronment.  Except  for  repairs  on  bulky  AN/TTC-7  equipment  and 
pennanently  mourited  mobile  units,  all  work  is  performed  in  the  shop  shelter. 

A shelter  may  be  located  singly  or  several  shelters  may  be  grouped  for  large 

^ maintenance  operations, 

5.  Special  physical  demands.  In  addition  to  the  crowded  working  conditions 
in  each  shelter,  a 12-hour  workday  is  considered  normal  in  combat  zones 
with  emergencies  requiring  additional  time. 

6.  Supervision  and  assistance.  Usually  available  for  newly  assigned  job- 
holders . 

Level  III  - Direct  Support  Maintenance  Onsite 
1.  When  equipment  cannot  be  repaired  by  organizational  maintenance 
personnel  and  the  equipment  is  too  bulky  to  be  easily  moved,  direct 
support  personnel  perform  maintenance  onsite,  Generally,  onsite  DS  repair 
is  limited  to  direct  exchange  of  assemblies  although  some  systems  main- 
tenance and  piece-part  repair  is  also  performed. 


2.  DS  personnel  travel  to  the  site  In  a truck  and  carry  their  own  tools 
and  test  equipment  with  them.  Replacemenl  parts  and  assentlies  are  also 
transported  from  the  shelter  to  the  site.  Therefore,  DS  repairmen  must 
estimate  probable  malfunctions  from  infonnation  provided  by  the  using 
organization  ar.d  select  the  proper  tools  and  test  equipment  that  must  be 
transported. 

3.  Job  aids,  environmental  conditions,  and  physical  demands  are  the  san:e 
as  for  organizational  maintenance,  Level  1. 

4.  Onsite  DS  rep.ninnen  work  without  direct  supervision  hut  are  assisted 
by  organizational  personnel.  In  most  cases,  only  experienced  repnirinon 
perform  onsite  maintenance. 

Level  IV  - General  Support  (GS)  Maintenatice  Shop 
1.  General.  GS  maintenance  is  performed  in  a permanent  building  which 
houses  till  necessary  tools,  Lest  equipment,  replacement  parts,  workbenches, 
and  required  power  connections.  Iiiinediately  outside  the  building  is  a 
iiardtop  surface  used  for  the  repair  of  trtobile  equipment.  The  shop  is 
usually  divided  into  six  distirret  areas--shipping  and  receiving,  prerepair 
inspection,  tr'oubleshooling  arrd  repair,  quality  control,  parts  and  storage, 
as  well  as  tire  administration  office  and  technical  library.  With  the 
exception  of  large  mobile  units,  all  equipment  enters  the  shipping  and 
receiving  area  as  a major  item,  asseiitbly,  or  sub^sssenirly . Front  the 
receiving  area  all  equipment  is  sent  to  the  prerepair  tasting  area 
whe’"e  decisions  are  made  to  either  repair  the  equipnrent,  setrd  it  to 
depot  for  rebuild,  or  salvage  it,  Lquipmenl  to  be  repaired  is  tlren 
sent  to  the  troub leshooting  arid  repair  area.  Reoaired  equipment  is 
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sent  to  the  quality  control  a'-ea  whore  general  support  final  tests  are 
performed.  Equipment  ineeting  final  test  standards  is  outprocessed  and 
cither  sent  back  to  the  using  unit  or  placed  in  storage  for  future  use. 

Large  mobile  units  are  parked  on  the  hardtop  outside  the  shop  and  repairs 
and  final  tests  are  performed  within  the  mobile  unit.  Required  maintenance 
and  shop  records  are  filed  in  the  mobile  unit.  Necessary  maintenance  and 
shop  records  are  filed  in  the  shop  administrative  office. 

2.  Tools  and  test  equipment.  All  tools  and  test  equipment  normally 
available  at  organisational  and  direct  support  maintenance  level  are 

also  available  in  the  general  support  shop.  Moreover,  the  GS  shop  includes 
any  tools  and  test  equipment  required  for  general  support  testing. 

3.  Job  aids  and  manuals.  All  pertinent  technical  manuals  art  available  in 
the  GS  shop  as  well  as  numerous  test-jigs  and  interconnecting  rabies 
required  for  efficient  troubleshooting  and  final  testing. 

4.  Environment.  Most  general  support  maintenance  is  perfomied  in  the  shop. 
The  repair  of  mobile  units  may  expose  the  repairman  to  weather  but  the  work 
can  usually  be  scheduled  so  weather  causes  no  problems. 

5.  Special  physical  demands.  No  special  physical  demands  are  made 
on  the  incumbent  working  at  GS  level. 

6.  Supervision  and  assistance.  Both  supervision  and  assistance  are 
always  available  at  the  GS  level. 


APPENDIX  B 


A.  SOURCES  OF  TRAINING  COURSES  AND  INSTRUCTIONAL  MATERIALS 


AIR  FORCE 

Extension  Institute  Catalog  and  Guide.  ECIRP  50-1,  Extension  Course 
Institute  Air  Univer  sity,  Gunter' Air  Force  Station,  Alabama.  1974. 

Instructor's  Guide  to  Survival  Training  Films.  ADTIC-PUC-G-111. 
Arctic-Desert-Tropic  Information  Center,  Air  University,  Maxwell 
Air  Force  Base,  Alabama. 

Mather  Air  Force  Base  Learning  Center  Catalog.  Headquarters , 323d 
FlyTngTrainlng  Wing,  Matner  Air  Force  Base,  California,  95655. 

1973. 

USAF  Formal  Schools  Catalog.  AFM  50-5.  Headquarters,  U.S,  Air  Force, 

' Wa'ihington D.C. , 20330.  1973. 

Note:  Addtl’onat  Sources  conprise  USAF  Study  Reference  Lists,  Specialty 

Training  Standaids,  and  Career  Development  Courses. 


ARMY 

Announcement  of  U.S.  Army  Correspondence  Courses.  DA  PAM  351-20. 
Headquarters , Dept,  of  the  Arw,  Washington,  D.C. 

Army  Correspondence  Course  Program.  DA  PAM  350-2.  Headquarters,  Dept, 
of  the  Army,  Washington,  D7C.  1973. 

Index  of  U.S.  Arm-/  Motion  Pictures.  DA  PAM  108-1.  Headquarters,  Dept, 
of  the  Army,  Washington,  D.C. 

Interservice  Formal  School  Training  for  POO  Civilian  and  Military 

Personnel . Army  Regulation  351-'9 . Dept . of  the  Army,  Washing  ton , 

dtt: 


USAFI  Correspondence  Courses ■ DA  PAM  350-6.  Headquarters,  Dept,  of 
the  Army,  Washington,  D.C. 

U.S.  Army  Formal  Schools  Catalog.  DA  PAM  350-10.  Headquarters,  Dept, 
of  the  Army,  Washington,  D.C.  1973 


MARINES 

Basic  School  Extension  Catalog.  Director,  Extension  School,  Education 
Center,  MCDEC,  Quantico,  Virginia,  22134. 
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Marine  Corps  Formal  School  Cat.alor;.  MC0-P1500. 12F.  Headquarters, 

United  States  Marine  Corps,  Washington,  O.C.  1973, 

Marine  Corps  Institute  Handbook  (12th  Edition).  MC0-P1550. IH.  Director, 
Marine  Corps  Institute,  Marine  Barracks,  Box  1775,  Washington,  D,C. 
1973. 


HAVY 

Catalog  of  Navy  Training  Courses  (Vols.  1,11,  and  III).  NAVEDTRA  10500. 
Chief  ot  Naval  Education  and  Training  Support,  Pensacola,  Florida, 
32508.  1974, 

Docurrentary  Film  Catalog  (Revision  #1).  NWC-TP-4784-REV-1.  Commander, 
FlavaT  Weapons  Center,  Cuwa  Lake,  California,  93555.  1971. 

Films  on  Oceanography.  Catalog  Series,  NODC-C-4.  U.S.  Naval  Oceano- 
graphic  Data  Center,  Washington,  D.C.,  20390.  1963. 

Motion  Picture  Catalog  of  Films  Aval lable  Through  the  External  Relations 
Group  Motion  Picture  Pro.1ecU  T6-533A.  Commander,  Naval  Air  Systems 
Corranand,  Washington,  DC,,  20360.  Attention:  AIR-604A1.  1966. 


OTHER  FEDERAL  GOVERNMENT  SOURCES 

Educational  Resources  Information  Center  (ERIC),  National  Center  for 
Educational  Communication,  400  Maryland  Avenue,  Southwest, 

Washington,  P.C. , 20202, 

National  Referral  Center  for  Science  and  Technology,  Library  of  Congress, 
First  and  Independence  Avenue,  Southeast,  Washington,  D.C.,  20540. 

Report  Bibliography.  Defense  Documentation  Center,  Defense  Supply 
Agency,  Cameron  Station,  Alexandria,  Virginia,  22314. 

U.S.  Government  Films:  A Catalog  of  Motion  Pictures  and  Filmstrips  for 
SaTe  by  the  National  Audio  Visual  Center.  National  Archives 
Publication  No.  70-3,  Nat i oha 1 ~Arch i ves , Washington,  D.C, 


OTHER  GENERAL  SOURCES 

Directory  of  Educational  Information  Resources.  Com  Information  Corpo- 
ration, New  York,  1971. 

ERIC  Document  Reproduction  Service  (EDRS).  Leasco  Information  Products, 
4827  Rugby  Avenue,  Bethesda,  Maryland,  20014. 
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ERIC  Clearinghouse  on  Educatfonal  Media  and  Technology.  Institute  for 
Comminlcation  Research,  Stanford  University,  Stanford,  California, 
94306. 

Educator's  Purchasing  ^stcrs  (Vol.  I).  Instructional  Materials, 
Elsher  Rub'lishfng  Co.,  Englewood,  Colorado.  1971. 

New  Educational  Materials,  1970.  Citation  Press,  New  York.  1970. 

E.  SOURCES  OF  JOB  ANALYSIS  DATA 

AIR  FORCE 

Comprehensive  Occupational  Data  Analysis  Program  (CODAP) 

The  Job  Specialty  Survey  Division  Reports,  Lackland  AFB,  Texas 

Occupational  Survey  Reports,  Occupational  Measurement  Center,  Lackland 
AFB,  Texas 

The  Personnel  Research  Laboratory  Reports,  Lackland  AFB,  Texas 


ARMY 


Military  Occupational  Data  Bank 


NAVY 

Navy  Occupational  Task  Analysis  Program  (NOTAP) 


C.  SOURCES  OF  INFORMATION  ABOUT  PARTICULAR  JOBS 


Classification  manuals  which  contain  official  descriptions,  such  as: 
AFM  39-1,  Airman  Classification  Manual;  AFM  36-1,  Officer 
Classification  Manual 


Field  manuals  which  contain  doctrine,  tactics  and  techniques 

General  Guides  which  include  related  sources,  such  as  Air  Force 
requlations  in  the  0-series: 

AFR  0-1,  Guide  tc  Indexes,  Catalogs  and  Lists  of  Departmental 
Publications 


AFR  0-2,  Numerical  Index  of  Standard  Air  Force  Publications 
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AFR  0-6,  Subject  Index  of  Air  Force  Publications 
AFR  0-9 , Nuniberlca^  Index  of  Departmental  foms 

Job  descriptions  such  as  the  Officer  Grade  Requirements  and  Job 
descriptions  reported  by  individual  Air  force  officers 

Logistic  support  plans  which  indicate  materials  and  services  ussociated 
with  weapon  systems 

Maintenance  allocation  charts  which  designate  authorization  to  perfonn 
maintenance  tasks 

Manuals  which  explain  equipment  or  systems 

Military  writings  such  as  tactical  reports,  historical  records,  and 
reports  of  maneuvers  and  field  tests 

Modification  wo>^k  orders  which  furnish  instructions  for  alterations 
and  modifications  to  material 

Regulations  wtih  state  policies,  responsibilities,  and  administrative 
procedures 

Standard  operating  procedures  which  provide  actual  job  performance 
requirements 

Tables  of  organization  and  equipment  (TOE)  and  tables  of  distribution 
and  allowance  (TOA)  which  include  information  on  position  titles, 
job  distribution,  supervision,  and  equipment 

Technical  manuals  and  bulletins  which  cover  equipment  operation  and 
maintenance  procedures 


JOB  INVENTORY 

(!iUTY  TASK  LIST) 


921X0/922X0 


P.ifjL'  7 of  44 


1 

Check  tasks  vtm  Poi  form  now  \ 

2. 

Aild  any  tasks  you  lo  now  wh'Ch  arc  net  listed. 

In  the  ’Ttm»?  Spt'ni  ' column,  tate  checketl  (^^Masks  on  time  spent  m your  piesent  job 

3 

1 

? 

Time  Spent  Scale 

VEHV  MUCH  BEI  OW  AVEHAGE  4 ABOUT  AVERAGE  / 

BELOW  AvERAt.E  5 SLIGRTLV  ABOVE  AVERAGE 

bUGHiLV  BEl  CiW  AVERAGE  b ABOVE  AVERAGE 

VERY  MUCH  ABOVE 
AVERAGE 

c. 

FITTING  AND  MAINTAINING  LIFE  RAFTS  AND  PREf'RVERS 

1 

Clean  lift  preservers 

42 

j. 

CiMn  III*  riltl 

43 

3. 

Cotsdemn  non-reparable  life  rafts  or  Ide  preservers 

44 

4. 

Fit  life  preservers 

45 

5. 

ln«MCt  life  preservers 

46 

6. 

Inspect  fife  raft  accessaries 

47 

7.  Inipect  lir«  ra^ti 


8.  Impact  or  weight  t«$.  ca«t>on  diOMkt*  cyli^«r$  or  cartr»<S9a$ 


9.  Make  entries  on  or  review  Life  Preserver  Data  forms  <APTO  Porm  4€6) 


10.  Make  entries  on  rf  review  Life  Preserver  Infection  Data  Record  forms  fAPTO  Porm  336> 


TIME  SPLNl 
DOING  THrsL 
TASKS  IN 
PRESENT  JOB 


1 1 .  Make  anrriei  o i or  review  Life  Haft  Infection  Record  forrm  (AFTO  Form  3371 


12.  Make  entn*  s on  or  review  User  Certification  Label  forms  lAKTO  Form  271 


13.  Pec-:  life  prfserven 


. Pack  life  ^aft  accessory  containers 


15.  Pack  li  .e  rafts 


16.  Perform  functional  tests  of  life  preservers 


17.  ^erform  functiorial  tests  of  life  rafts 


18.  Perform  inflation  tests  of  life  preservers 

19.  Perlorm  intIdTion  t«ti  of  life  rafts 

20.  Perform  minor  repairs  to  life  preservers  such  as  patching  rips,  tears,  or  holes 


(Continued  next  page) 
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SAMPLE  OF  A MACHINE  SCORABLE  QUESTIONNAIRE 
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7 Not  ve»v 
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1 Vwy 


I Pvifo'tTt  Oro^iiaiion^j  Support  Activittet 


A.  P*flo«w  Comp.»oy/Houtint  Ad'nirnitr Jtion 

I.  Ffi»(Mrc/>*ud<t  RflJOM  (QA  F<»»m  t) 

7.  Verity  MO'Pin^  HepOM  lor  (^tiectoeit ' 

Comptyienttj  


3.  Wjl<«  Lo<re(.tKjni  on  Morning  Report 


4.  Review  Mornmg  R^iari  (E«tr»  r lo' 
Correc(r>e4'CorT^etenes«  . . 


S.  Pr»(Mf«  S<0P£RS  Input  o<kJ  Control  Uste 
Form  (OA  Form  37281  


8.  £rtit  OA  Pgrm  3?S8  lor  Coriectr^n' 
Comi>t«t«ne$»  


7.  fleceiiiC/Profesi  lr>com*ng  Fertormel  . , . 

8.  Proc-.M  Oulgcimg  Penonnel  

9.  Moiriiain  Per»onnel  Q.’fj  CA'di  

10.  M3irtain/Uw  Perionr>e’  Information  Hotter 

1 1 . Recommend  Sut>ord*n3iei  lor  Decorat  ronj/ 

Awertli  


12.  Proces  CaMialiv  Reporti  . . 
13  Pfooea  Congresfionallnquiriet 


14.  Prepare/Meintam  Org^nizaiionaU 
FunciKjnol  Charts  


15.  Preparc/Appfove  Sicif  Slips  .... 

16.  Coordinate  Leaves/Passes  . . 

17.  AsPii  in  Preparation  lor  Inactions 

18.  Atsitt  in  Corvlpct  of  Inspections 

I.  Prepare  Work  Schedules  


Twice  pet 
^ek  ut  mote 

4 Perfo'med 
imrnediatelv 

4 Littremsly 

K'lOUS 

I / J 4 
0 0 0 0 

1 7 j 4 

0 0 0 D 

i i i A 
0 0 0 0 
t / ) 4 

n n n n 

17  3 4 

0 0 0 D 

t 7 J 4 

n n n n 

Hod 

12  3 4 

n n 1 n 

U u u u 

17  3 4 

0 0 0 'll 

17  3 4 

n n n n 

u u u u 

17  3 4 
0 0 0 0 
17  3 4 

n n n n 

Li  U IJ  u 

17  3 4 

D D 0 0 

17  3 4 

n n n n 

u u u u 

17  3 4 
0 0 0 0 

U u U U 

12  3 4 
0 0 0 0 

U 'J  U U 

Hio 

1 7 i 4 

0 0 0 0 

0 0 0 0 

yfi5 

17  3 4 
0 0 0 0 

17  3 4 
0 0 0 0 

HH 

Hofi 

17  3^ 
0 0 0 0 

17  3 4 

GOOD 

17  3 4 

D 0 0 0 

HH 

DODO 

12  3 1 
0 0 0 0 
12  3 4 
0 0 0 0 

HOD 

oHfl 

oy  0 

17  3 4 

0 0 0 0 

ooy 

HOQ 

12  3 4 
n n n n 

12  3 4 
0 0 0 0 
17  3 4 

12  14 

ODOO 

A n ri  H 

0 0 0 0 
1^34 
0 0 0 0 

0 0 0 0 
17  3 4 

0 0 0 0 

Q 0 0 0 

Qoy 

1 ? 3 4 

0 0 0 0 

12  3 4 

0 0 0 0 

6y  0 

17  3 4 

0 0 0 0 

12  3 4 

0 0 0 D 

oHS 

'734 
0 0 0 0 

12  3 4 
0 0 0 0 

ooy 

12  3 4 
0 0 0 0 

17  3 4 

ODOO 

yy 

iSVI  »«  ■ I'Hir^  ' 


>■  I >1  ( 111 


A 

FR£QU6NCV 
Of  TA5K 
PERfOHMANCE 

& 

TiMl  SEIWEEN 
JOB  ENTRY 
AND  task 
^rfohmance 

c 

PRO.  AHLI: 
CONStOUENCCS 
OF 

INAOEQUATE 

PERFORMAMceS 

1 Ntv«* 

1 Parh^rmii 

1 N*9lf0drt« 

7 L4M  thgn 

t.'K* 

? P**fo*»n«1 
«4t«*  W 

t^% 

7 N01  y*ry 
»inlu« 

3 At  lc»l 
monttily,  iml 
l«s»  th«n 
Iwhc#  (>a* 

3 fntt:>r/^i^ 

90 

3 Ve*» 

4 I’tttct  fte* 

p>  mote 


4 Ptflt>fmed 


4 Ekrr«fn«4v 


B.  1 Make  Wo'k  4tl*9nment»  . . . , 
'J.  Pr«0*r«  (A/tv  PoftOf  (DA  form  6) 

3.  M>niktn  Duty  M<v>f*c 


C PfoceM  Coi'«CK»f-itfr»-.# 


1.  Co'fMpondAnc* 


0 0 0 0 
*23* 
0 0 0 0 
\ 2 y A 

OODD 

* 2 ) A 

D 0 0 0 

1^)4 

0 0 0 0 


' / 3 i 
0 0 0 0 
1^34 
0 0 0 0 
< ^ J 4 

ODDO 

t ; 3 4 
0 0 0 0 
I i » 4 

OOuD 


oH  0 
Hoo 
0 0 0 6 
0(100 


if.  Revi«Mi  CorrnpoiKtcnc*  lor  format! 
G**rnm4f/CO«t^ot  

3,  COf'Kl  £rrOrt  •<*  Corr^tponcMfoc^ 

4 Howf«  0«M90*n9  Co'ftHMndtnc* 

5.  R»c*<vt  tnd  Di>lr^t«  Incomfne 
Cwfwpoftdmc# 


* / ) I 

1 OD  0 0 


Hy  yi!3 

yy  yy 
y y y y 
yy  yy 


If  • ih^  VC7U  patiotm  ii  not  wriic  >( 

>n  th*  blw»«  «o»c«i  Mow 


0 0 0 0 


0 


0 


0 


yy  yy  yy 
y y y y oh  o 
yy  yy  yy 

t 2 f * t?)4  y I 2 * 

0000  0000  0000 

yy  yy  yy 

yy  yy  yy 

i;J4  )?34  1234 

0000  0000  0000 

y y y y y y 

y y y y y y 

yy  yy  ^yo 


■<  r*  n f s * j j » * t»  / 1 


APPENDIX  E 


INSTRUCTIONS  FOR  USE  /UID  A0MINISTPJ\T10N  OF  QUESTIONNAIRE 
TO  THE  NONCOFUISSIONED  OFFICER: 

This  questionnaire  is  part  of  a field  survey  desiqned  to  identify 
tasks  for  military  police  training.  Its  specific  purpose  is  to  obtain 
from  you,  uhe  Noncoiiinii <•. -i cried  Officer,  intorination  on  task  criticality 
and  frequency  of  performance,  Feedback  gained  from  this  questionnaire 
will  play  a major  part  in  redesigning  the  Noncommissioned  Officer 
Advanced  Education  System.  The  ultimate  goal  is  to  design  training  so 
that  it  reflects  what  we  have  learned  from  you  in  the  field.  This  goal 
is  possible  only  vrith  your  full  cooperation.  Consider  eacii  task  listed 
in  this  questionnaire  carefully  and  give  your  best  response.  Your 
cor.iribu ".ion  is  essential  to  a successful  survey. 


Preceding  page  blank 
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PART  I 


GENtRAL  INSTRUCTIONS 


1 Complete  this  survey  questionnaire  within  the  titna  specified  by 
your  unit  project  officer  and  return  it  to  him  upon  completion. 

2.  Because  instructions  for  completing  each  part  of  this  survey 
questionnaire  are  different,  read  aJJ_  instructions  carefully, 

3.  Part  II  requires  that  you  supply  biographical  information.  This 
information  will  be  used  to  correlate  feedback  received  from  the  field. 
Print  all  answers  in  the  spaces  provided  on  tiie  appropriate  survey 
questionnaire  page. 

4.  In  the  upper  fight  corner  of  each  page  of  Part  III,  Task  Inventory, 
of  this  survey  questionnaire  is  a BOOKLET  NUMBER  block.  Irmtediateiy 

to  the  left  of  this  block  is  the  individual  Lnnklet  number.  Print  the 
individual  booklet  number  in  the  BOOKLET  NUMBER  block  on  each  page  of 
the  Task  Inventory  as  demonstrated  in  the  example. 


EXAMPU: 


(000345) 


TOCtTNOMlUr 

0 1 2 • A'  5 B 7 8 9 

0 1 2 5'  1 TT*1» 

ITT  2 ' T r”!"  6 7 “ 8 ^ 

5,  Part  III,  Task  Invetitory,  is  divided  into  nine  (9)  separate 
sections  (Sections  I'lX).  The  content  of  these  sections  concerns  tasks 
you  may  perform  in  your  present  duty  assigntnenc.  You  are  asked  to 
rate  each  task  in  accordance  with  three  criteria  - frequency  of  task 
performance,  immediacy  of  task  performance,  and  importance  of  task  to 
mission  success. 

Base  all  selections  on  your  experience  in  your  pro  cut  duty  a.ssigninent. 

a.  Column  A requires  that  you  rate  how  often  yi'u  pet  For  n each  task 
on  a scale  from  one  to  four.  The  criterion  for  thin .rating  is  the 
frequency  of  task  performance.  Those  tasks  perforTiec  most  frequently 
will  normally  be  rated  four^  while  those  tasks  not  pet  Tormed  at  .all  will 
be  rated  one. 
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b.  Column  B requires  that  you  determine  how  soon  you  must  be  capable 
of  performing  each  task  after  report  ng  to  your  present  duty  assignment. 
Tlie  criterion  for  this  rating  is  the  irmediacy  of  task  performance.  Of 
the  four  possible  responses,  select  the  one  most  nearly  describing  your 
requireinents . Select  resnonse  number  four  for  those  tasks  which  you  must 
bo  capable  of  performing  inmedi.  uely  upon  reporting  for  duty.  Select 
response  number  on^  fortthose  tasks  which  you  never  perform. 

c.  Column  C requires  that  you  describe,  in  your  opinion,  how  im- 
portant each  task  is  to  mission  success.  The  criterion  for  this  rating 
is  the  importance  of  the  tas.'c  to  the  accompl i'hment  of  the  unit  mission. 
Those  tasks  that,  i.i  your  or>inion,  are  most  important  to  mission  success 
will  be  rated  four  while  those  tasks  that  you  consider  least  important 
will  be  rated  one. 

6.  After  selecting,  enter  your  responses  for  each  task,  using  either 
a pen  or  pencil,  in  the  answer  portion  adjacent  to  the  appropriate  task 
statement  as  demonstrated  in  thu  example. 

EXAMPLE : The  task  PREPARE  CORRESPONDENCE,  if  rated  as  performed 

FREQUENTLY  in  Column  A,  identified  as  must  be  capable  of  performing 
IMMEDIATELY  in  Column  B,  and  determined  by  you  to  be  MOST  IMPORTANT  in 
Column  C,  would  be  entered  In  the  answer  portion,  as  shown  below. 


PREPARE  CORRESPONDENCE 


1234  123  4 1234 

DDIDDDIDODI 


7.  After  each  section  of  Part  III,  Task  Inventory,  is  a Write-In 
Section.  These  write-in  sections  are  provided  in  order  that  you  may 
comment  on  each  task  inventory  section,  or  list  any  task(s)  you  think 
should  be  included  in  the  Task  Inventory.  These  sections  also  allow 
you  to  comment  on  those  tasks  that  you  find  are  the  most  difficult  for 
you  to  perform. 


PROJECT  OFFICER  INSTRUCTIONS 


1.  Genera] . The  MrUtary  Police  School  is  '•urrently  Involved  in  re- 
der.igning  bflsic  military  police  training  to  produce  military  policemen 
better  equipped  to  perform  when  they  reach  the  urit.  The  emphasis  is 
toward  training  replacements  in  tasks  actually  being  performed  in  the 
field.  The  questionnaires  in  this  packet  are  designed  to  identify 
those  tasks, 

■’'he  care  with  which  you,  the  project  officer,  administer  the 
questionnaires  will  determine  the  accuracy  of  field  feedback  and,  con- 
sequently, the  success  or  failure  of  this  project. 

2.  Survey  Packet  Contents. 

a.  Questionnaire 

b.  Supervisor  Questionnaire 

c.  Project  Officer  Instructions 

d.  Answer  Sheets  for  Questionnaire 

e.  Pencils  for  use  on  answer  sheets. 

3.  Responsibilities . 

a.  Unit  Coirmander.  The  unit  commander  is  requested  to  appoint  a 
project  officer  and  to  mo''itor  administration  of  the  survey, 

b.  Project  Officer.  The  project  officer  is  responsible  for  the 
control  and  handling  of  questionnaires,  for  the  administration  of  the 
qut:stionnaires,  and  for  returning  completed  and  unused  questionnaires 
to  the  Military  Police  School. 

c.  Questionnaire  Administrator.  The  project  officer  may  appoint 
someone  to  administer  the  questiont.aire,  if  necessary.  Normally,  how- 
ever, it  is  recommended  that  the  project  officer  administer  the 
questionnaire  himself. 

4.  About  the  Questionnaires. 

a.  Questionnaire.  This  questionnaire  is  designed  to  identify 
tasks  being  performed  by  military  policemen  in  the  field  and  the 
frequency  with  which  each  task  is  performed. 

b.  Supervisor  Questionnaire.  The  supervisor  questionnaire  is 
programmed  to  provide  feedback  on  task  criticality,  probability  of 
deficient  performance,  tnd  the  frequency  with  which  each  task  is 
performed. 
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5.  Who  Takes  The  Questionnaire.  The  project  officer  is  responsible  for 
selecting  individuals  to  take  the  questionnaires  (respondenti)  within 
their  units.  Those  selected  must  meet  the  requirements  listed  below: 

a.  The  questionnaire  respondent  must: 

(1)  Be  In  an  M.P,  duty  assignment  (actually  performing  M.P 
duties) 

(2)  Have  been  on  the  job  at  least  90  days 

b.  Tn^  respondent  to  the  Supervisor  Questionnaire  must: 

(1)  Command  or  supervise  M.P.  personnel 

(2)  Have  been  in  a coimand  or  supervisory  position  in  the  unit 
for  90  days.  (Assign  questionnaires  proportionately  among 
officers  and  NCO's.) 

6 . Questionnai re  Administration. 

a.  Questionnaire.  The  questionnaire  will  be  administered  in  a 
controlled  environment.  Persons  participating  in  the  survey  will  be 
allowed  two  hours  to  complete  the  questionnaire  and  will  turn  the  ques- 
tionnaire and  ..nswers  sheets  in  to  the  questionnaire  administrator 
prior  to  leaving  the  survey  area.  Individual  questionnaires  and  their 
accompanying  answer  sheets  will  be  kept  together. 

See  attached  item  for  the  procedure  to  be  followed  in  administering 
the  questionnaire. 

b.  Supervisor  Questionnaire.  Supervisors  selected  as  respondents 
for  this  questionnaire  will  be  allowed  to  sign  for  the  questionnaire  and 
take  it  with  them.  They  will  coniplete  the  questionnaire  and  return  it  to 
the  project  officer  within  a time  frame  he  specifies.  This  time  frame 
must  be  compatible  with  the  suspense  date  to  the  Military  Police  School. 

7.  Questionnaire  Hand! inq.  Questionnaires  and  answer  sheets  become 

FOR  OFFICIAL  u5e  ONLV  when  completed.  For  ease  of  accounting,  each 
questionnaire  and  its  accompanying  answer  sheets  are  numbered.  All 
questionnaires  must  be  returned  to  the  Military  Police  School  whether 
they  are  used  or  not.  Instructions  for  returning  the  questionnaires 
to  the  Military  Police  School  are  contained  in  the  basic  letter.  If 
you  have  any  problems  or  questions,  contact  (NOTE:  Give  name  or  names, 

address,  and  telephone  number). 


Ill 

AmiNISTERING  THE  QUESTIOHNAIRE 


A-1.  Preparation.  A classroom  or  training  room  equipped  with  desks 
will  provide  the  most  ideal  site  for  ackninistering  the  questionnaire. 
Questionnaires,  answer  sheets,  and  two  electrographic  pencils  should  be 
issued  to  participants  after  everyone  who  is  to  take  the  questionnaire 
has  arrived.  This  ensures  that  everyone  starts  together. 

A-2.  Instructions.  The  questionnaire  administrator  will  present 
the  following  instructions. 

a.  "Is  there  anyone  here  who  is  not  working  in  an  M.P.  duty 
position?  Is  there  anyone  here  who  has  not  been  assigned  to  their 
present  duties  at  least  90  days?  It  so,  please  leave  at  this  time." 

b.  "Will  everyone  at  this  time  please  read  the  first  page  in  the 
questionnaire  which  has  been  issued  to  you." 

(Note  to  the  administrator;  It  must  be  emphasized  that  your  enthusiasm 
for  this  project  or  lack  of  it  will  be  contagious.  It  is  important  that 
you  demonstrate  a positive  attitude  to  the  participants.  Allow  time  for 
the  lirst  page  to  be  read  and  underline  the  importance  of  the  question- 
naire with  the  following  statement.) 

"I  would  like  to  stress  the  importance  of  this  questionnaire.  The 
Military  Police  School  wants  to  design  training  to  fit  the  job  in  the 
field.  You  are  the  only  people  who  can  tell  them  what  they  need  to 
know.  Please  think  through  each  question  and  give  your  best  answers." 

c.  "Turn  to  Part  I,  Biographical  Information,  and  answer  questions 
1-13.  When  you  have  finished,  lay  your  pencil  on  the  desk  so  1 will 
know  when  to  proceed  to  the  next  step." 

d.  "Now  read  the  instructions  found  in  Part  II." 

(Note  to  the  administrator:  Allow  reasonable  time  for  everyone  to 
finish  befor^e  moving  to  the  next  step.) 

"Are  there  any  questions?" 

e.  "As  you  read  in  the  instructions,  there  are  nine  answer  sheets 
accompanying  your  questionnaire.  Take  the  answer  sheets  and  number 
them  one  through  nine  to  correspond  to  the  first  nine  sections  in 
Part  III  of  the  questionnaire.  If  you  do  not  have  nine  answer  sheets, 
raise  your  hand--I  have  extra  ones.  Use  a separate  answer  sheet  for 
each  section.  Answer  only  the  number  of  questions  listed  in  each 

and  move  to  the  next  section  and  answer  sheet.  It  is  not  necessary  to 
write  your  name,  rank,  the  date,  or  course  at  the  top  of  the  answer 
sheet.  Also,  disregard  the  blocks  marked  score,  grade,  extra  points, 
and  social  security  number." 


f.  "Because  of  the  size  of  this  survey,  these  answer  sheets  will 
be  read  by  machine.  You  must  use  the  special  pencils  provided  so  that 
the  machine  can  read  the  answers.  lAien  marking  your  answer,  take  care 
to  fill  the  vertical  rectangle  outlining  the  letter  as  shown  by  the 
example  o.i  page  4 of  tho  Instructions.  Also,  please  be  sure  not  to 
make  any  striy  marks  on  the  answer  sheets.  Finally,  do  not  fold  the 
answer  sheets." 

g.  "All  answers  must  be  based  on  your  experience  in  this  your 
present  unit.  Do  not  call  on  experience  In  previous  units.  This  means 
that  If  you  do  not  perform  a particular  task  in  your  present  unit,  you 
must  mark  do  not  perform  this  task'on  your  answer  sheet." 

h.  "lou  n^y  begin  answering  part  III.  Remember  Section  ten,  the 
written  section.  When  you  finish  answering  all  questions.  Insert  your 
answer  sheets  into  the  questionnaire  and  turn  them  In  to  me.  You  may 
leave  when  you  are  finished.  Are  there  any  questions?" 

A-3.  Conclusion.  After  everyone  has  taken  the  questionnaire,  ensure 
that  all  questionnaires  and  answer  sheets  are  accounted  for.  Collect 
the  pencils  provided  so  that  they  may  be  returned  to  the  Military  Police 
School  along  with  the  questionnaires  and  answer  sheets. 
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FIGURE  1 .6:  Ffowcharl  of  Block  I . |;  ANALYZE  JOB 


BLOCK  1.2:  SELECT  TASKS/FUNCTIONS 
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OVERVIEW 

Some  tasks  are  seldom  required  on  the  job  and  only  minimum  job 
degradation  would  result  if  the  tasks  were  not  performed.  On  the 
other  hand,  some  tasks  are  highly  critical  to  successful  job  perfor- 
mance, and  ttie  complex  nature  of  the  task  makes  training  essential. 

Economic  and  time  considerations  require  a decision  as  to  which  tasks 
will  be  selected  for  training  and  which  tasks  will  not.  The  purpose  of 
this  selection  process  is  to  make  sure  some  form  of  instruction  will  be 
provided  for  all  the  important  tasks  and  that  instructional  resources 
will  not  be  wasted  on  unimportant  tasks.  | 
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SELECT  TASKS/FUNCTIONS 
1.0  INTRODUCTION 

As  a result  of  the  job  analysis  in  Block  1.1,  all  tasks  have  been 
identified  for  a particular  job.  A strong  possibility  exists  that 
some  of  these  tasks  require  no  training  since  all  or  most  job  incumbent? 
could  easily  perform  the  tasks  wi thout  training.  Some  tasks  are  seldom 
required  on  the  job  and  only  minimum  job  degradation  would  result  if 
the  tasks  were  not  performed.  On  the  other  hand,  some  tasks  are  highly 
critical  to  successful  job  perfoi'mance,  and  the  complex  nature  of  the 
tasks  makes  training  highly  desirable. 

Economic  and  time  considerations  require  a decision  as  to  which  tasks 
will  be  selected  for  training  and  which  tasks  will  not.  The  purpose  of 
this  selection  process  is  to  make  sure  some  form  of  instruction  will  be 
provided  for  all  the  important  tasks  and  that  instructional  resources 
will  not  be  wasted  on  unimportant  tasks. 

"Training,"  as  discussed  in  this  block,  is  not  necessarily  resident 
school  training.  Formal  training  programs  can  take  a number  of  forms  such 
as  correspondence  study,  training  manuals,  individualized  learning 
packages,  formal  on-the-job  training  (FOJT)  programs,  group  training, 
as  well  as  installation  support  schools  and  resident  schools.  Also, 

Job  Performance  Aids  (JPAs)  may  be  developed  that  will  eliminate  or 
minimize  training  requirements  for  some  tasks.  In  this  block,  we  are 
using  "training"  in  a general  sense  to  include  Job  Performance  Aids 
even  though,  technically,  JPAs  are  a possible  alternative  to  training 
rather  than  an  actual  method  of  training. 
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Here,  you  will  r^t  make  a decision  as  to  the  method  of  training, 
how  difficult  training  is,  how  long  it  should  take,  where  it  should  take 
place,  who  should  do  It,  or  whether  all  ur  only  part  of  those  In  the  DOS 
should  De  tr  lined.  Y lu  will  use  the  criteria  approved  by  your  conwand 
to  select  those  tas’  that  will  reouire  training  and  to  set  aside  those 
tasks  for  which  t'-aining  will  not  be  provided.  Many  of  the  decisions 
listed  above  that  you  will  np^  make  in  this  block  will  be  made  in 
Block  1.5;  SLLECT  TRAINING  SETTING,  In  this  block,  you  will  collect 
and  consolidate  a considerable  amount  of  data  that  will  be  critical 
not  only  to  making  the  selection  decisions  in  this  block,  but  also  to 
making  the  training  setting  decisions  in  Block  1.5. 

There  are  good  reasons  why  every  task  should  not  be  included  in  the 
training  program.  The  consolidated  task  list  prepared  by  the  job  analysis 
team  detailed  the  full  dimensions  of  the  job  to  include  all  of  its 
variations  caused  by  the  mission  and  by  geographical,  procedural,  and 
environmental  conditions.  It  would  be  wasteful,  in  terms  of  time, 
personnel,  money,  and  other  resources,  to  provide  the  kind  and  amount 
of  instruction  required  to  equip  each  graduate  to  perform  every  task 
of  a particular  Defence  Occupational  Specialty  (DOS)  in  any  position 
in  the  world.  For  the  same  reason,  it  is  often  impractical  to  initially 
train  personnel  to  the  ultimate  level  of  proficiency  required  at  some 
future  assignment.  A situation  might  exist  where  two  or  more  similar 
tasks  are  considered  essential  to  adequate  job  performance.  However, 
it  may  be  that  if  a person  is  trained  to  do  one  of  the  tasks,  he  will 
then  be  able  to  perform  the  other  similar  tasks.  In  this  case,  it 
would  be  wasteful  of  training  resources  to  include  all  of  the  similar 
tasks  in  the  training  program.  These  are  just  a few  examples  of 
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why  all  tasks  are  not  trained.  Others  will  be  mentioned  later  in  this 
block. 

The  selection  of  tasks  for  training  is  a judgmental  procedure  that 
requi res : 

1.  a clear  understanding  of  the  duties,  tasks,  and  elements  that 
make  up  the  job, 

2.  analysis  of  collected  data  that  represents  the  judgments  of 
a relatively  large  number  of  individuals  who  are  familiar 
with  the  job,  and 

3.  an  understanding  of  the  resources  and  responsibilities  of 
the  Coimand  making  the  training  choices. 

As  you  work  through  the  following  section,  keep  in  mind  that  you 
are  not  trying  to  match  or  remenfcer  the  tasks  that  "have  always  been 
trained  in  school"  but  you  are  trying  to  decide  which  of  the  tasks  on 
the  list  are  of  enough  importance  to  justify  training  at  all.  It  is 
critical  that  you  decide  which  tasks  are  necessary  to  the  mission 
and  that  you  make  this  decision  in  a systematic  way,  using,  whenever 
possible,  the  advice  and  judgment  of  people  who  have  done  the  job  in  the 
real  world  setting. 

One  of  the  facts  of  life  for  those  involved  in  ISO  is  that  funds 
and  resources  usually  are  not  available  for  accomplishing  all  that 
you  think  should  be  done.  This  may  be  the  case  in  selecting  tasks  for 
training.  Some  tasks  that  you  think  should  be  trained  may  not  be  selected 
for  training  simply  because  sufficient  resources  are  not  available 
to  train  them.  However,  the  fact  that  resources  are  not  available  this 
year  does  not  mean  they  will  not  be  available  next  year.  For  these 
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reasons,  in  this  block  you  first  select  froiti  the  list  of  tasks  that  make 
up  the  Job  those  tasks  that  your  data  indicate  should  be  trained  if 
training  resources  were  not  o constraint.  Then,  with  inputs  and  assistance 
from  management,  determine  which  of  the  tasks  will  be  trained  in  view 
of  existing  constraints  of  money,  time,  personnel,  and  equipment. 

The  outputs  of  this  block  will  Include: 

1.  a list  of  tasks  that  your  data  indicate  should  be  trained 
if  no  resource  constraints  existed, 

2.  a list  of  ta«;ks  selected  for  training,  and 

3.  the  data  upon  which  the  above  decisions  were  based  and 
upon  which  additional  decisions  can  be  based  in  Block  1.5, 

The  steps  in  selecting  tasks  for  training  are  shown  in  Figure  1.12 
(the  fold-out  page  at  the  end  of  this  blockl. 

S.O  PROCEDURES 

You  arrived  at  this  point  in  the  ISD  process  by  one  of  two  routes. 

The  first  possible  route  was  that  you  analyzed  the  job  in  Block  I.l 
and  prepared  a list  of  duties,  tasks,  and  elements  that  make  up  the 
Job.  The  other  possible  route  was  from  Block  1.4:  ANALYZE  EXISTING 
COURSES.  Perhaps  in  analyzing  the  existing  courses,  you  found  the  original 
Job  analysis  adequate  for  your  needs,  but  you  found  the  procedures  and 
criteria  used  to  select  tasks  for  training  not  adequate.  This  means 
you  had  to  return  to  this  block  to  select  tasks  for  training  based  on 
criteria  that  meet  the  needs  of  your  command. 

In  either  case,  you  have  a consolidated  list  of  duties,  tasks,  and 
elements;  and  that  is  the  starting  place  for  this  block. 
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2.1  Select  Evaljation  Criteria 

Before  providing  you  with  Information  as 

to  tiow  to  select  evaluation  criteria,  the 
major  selection  criteria  will  be  described 
in  some  detail.  The  primary  thing  to 
remember  at  this  point  is  that  to  system- 
atically select  tasks  for  training,  there 
must  be  a basis  for  selections.  You  need 
some  important  I'acts  about  the  task  in 
order  to  make  the  selection  decisions. 

Most  likely  you  would  not  choose  to  train  a task  that  was  not  critical 
to  the  mission,  was  not  difficult  to  learn,  that  almost  everyone  could 
do  with  eas.;,  that  was  performed  by  only  a small  percentage  of  job  incum- 
bents, and  was  rarely  performed  at  all.  However,  you  would  have  no 
way  of  knowing  these  facts  about  the  task  if  you  had  not  selected  iiean- 
ingful  criteria,  and  then  obtained  responses  from  job  incumbents  and 
others  as  to  what  degree  each  t;isk  met  your  selected  criteria. 

2.1.1  Criteria  for  Selecting  Tasks  for  Training 

The  following  criteria  are  bases  for  selection  of  tasks  for  training. 
The  list  is  not  intended  to  be  ail  inclusive;  your  tasks  and  the  needs 
of  your  command  may  require  different  or  additional  criteria.  However, 
the  following  cover  most  situations  and  will  at  least  give  you  a good 
starting  point. 
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2. 1 ■ 1 , 1 Percent  Performing 

The  criterion  of  percentage  of  job  incumbents  who  perform  the  task 
points  to  the  need  foi  training  tasks  that  are  most  often  performed 
on  the  job, 

EXAMPLE 

One  task  for  a weather  technician  is  "answer 
telephone  inquiries  about  the  weather."  If  you 
found  that  96  percent  of  all  weather  technicians 
performed  this  task,  the  implications  for  training 
would  be  different  than  if  you  found  that  only 
10  percent  performed  it. 

In  the  above  example,  if  only  10  percent  of  job  incumbents  perform  a task, 
there  is  a strong  probability  that  90  percent  of  your  training  resources 
would  be  wasted  if  you  trained  all  weather  technicians  to  perform  the 
task. 

To  obtain  data  for  determining  the  percentage  of  job  incumbents  per- 
forming each  task,  simply  ask  on  the  questionnaire,  "Do  you  perform 
this  task?"  Or  calculate  the  percentage  performing  from  answers  to 
other  related  questions.  If,  for  e;<ample,  in  collecting  "frequency 
of  task  performance"  data  (this  criterion  will  be  discussed  further 
in  Section  2. 1.1.5),  one  of  the  possible  responses  is  "never"  or  "do 
not  perform,"  you  will  have  the  basic  data  for  determining  the  percent 
performing. 

2. 1.1.2  Percent  of  Time  Spent  Performing 

The  percentage  of  time  spent  performing  a task  is  a criterion  that 
points  to  a need  for  providing  training  to  assist  job  incumbents  in 


efficient  performance  of  those  tasks  on  which  they  spend  the  most  time. 
Selection  of  tasks  for  training  based  on  this  criterion  effeis  chances  for 
high  pay-off  in  terms  of  return  on  training  dollars  expended. 


s 

I EXAf-lPLE 

In  the  Protective  Equipment/Press'Jre  Suit  DOS, 

6.67  percent  of  average  time  of  all  nioiiibers  is 
spent  performing  J.he  task  of  "maintain  rigid 
survival  kits."  Only  0.16  percent  of  average 
tiifie  is  spent  on  the  task  of  "install  microphones 
In  oxygen  masks."  If  inore  effective  training 
could  increase  productivity  50  percent  in  the 
first  task,  3.33  percent  of  the  total  time  of  all 
ineinbers  miglu  be  saved.  Tills  would  be  a signifi- 
cant savings.  However,  if  productivity  were 
increased  50  percent  for  the  second  task,  only 
0.08  percent  of  the  total  time  would  be  saved. 

This  represenis  a much  smaller  savings  opportunity. 


To  obtain  data  for  determining  the  percentage  of  time  spent  perfor- 
ming the  tasks  in  a DOS,  inputs  are  required  from  a large  nuiifcer  of  job 
incumbents,  Usually  they  are  not  asked  to  state  tiie  percentage  of  their 
time  spent  on  each  task  because  such  a question  would  be  very  difficult 
to  answer.  Instead,  they  are  usually  asked  to  rate  each  task  as  to 
the  amount  of  time  spent  performing  it  as  compared  to  their  othsi’  tasks. 


EXAMPLE 


You  are  to  rate  the  relative  amount  of  time  you 
spend  performing  each  task  in  your  present  job. 
Relative  time  spent  means  the  total  time  you 
spend  doing  the  task  compared  with  the  time  you 
spend  on  each  of  the  other  tasks  in  your  present 
job. 


Use  a rating  of  "1"  if  you  spend  a "very  much 
below  average"  amount  of  time  on  a task. 
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Use  a rating  of  *'2"  for 

Use  a rating  of  ''3''  for 
time." 

Use  a rating  of  "4"  for 

Use  a rating  of  "5"  for 
time. " 

Use  a rating  of  "6"  for 

Use  a rating  of  "7"  for 
average  time." 


"below  average  time." 
"slightly  below  average 

"about  average  time." 
"slightly  above  average 

"above  average  time." 
"very  nwch  above 


From  the  above  information,  o computer  program  such  as  that  used  by 
the  Air  Force  with  their  Comprehensive  Occupational  Data  Analysis  Program 
(CODAP)  can  ompute  and  print  out  the  average  percent  of  time  spent  by 
merribers  of  the  DOS  who  perform  the  task,  and  the  average  percent  of 
time  spent  by  all  merrbers  of  the  DOS.  For  further  information  on  how 
this  precent  of  time  spent  is  derived,  see  .Appendix  A of  this  block. 


2. 1.1.3  Probable  Consequrnces  of  Inadequate  Performance 

The  criterion  of  probable  consequences  of  inadequate  performance  points 
to  the  need  for  selecting  tasks  for  training  that  are  essential  to  job 
performance,  when  needed,  even  though  the  tasks  may  not  be  performed 
frequently.  The  consequences  of  inadequate  performance  on  certain  tasks 
could  result  in  injury  to  personnel,  loss  of  11 "e,  or  damage  to  equipment. 
Inadequate  performance  could  have  a serious  impact  on  the  mission,  the 
operation,  the  product,  the  equipment,  or  the  operator. 


■1 
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EXAMPLES 

1.  More  and  more  electronic  equipment  is  being 
transistorized  and  is  therefore  less  subject  to 
malfunction.  This  fact  should  reduce  the  amount 
of  maintenance  training  that  an  operator  requires. 
However,  there  may  be  a nun^er  of  malfunctions 
that,  although  occurring  very  infrequently,  would 
be  extremely  critical  if  imn»diate  corrective 
action  were  not  taken  by  the  operator.  Severe 
damage  to  the  equipment,  materials,  or  products 
might  result.  Under  such  circumstances,  the 
criticality  of  the  infrequently  used  tasks  is 

so  great  that  it  must  be  considered  in  choosing 
tasks  for  training, 

2.  The  probable  consequences  of  inadequate  performance 
of  such  combat  tasks  as  “identify  enemy  aircraft" 
could  be  loss  of  life  and  equipment, 

3.  The  probable  consequence  of  inadequate  perfomiunce 
of  the  task  of  "write  trip  report"  is  negligible. 

If  tills  task  were  selected  for  training,  it  would 
be  on  the  basis  of  factors  other  than  probable 
consequences  of  inadequate  performance. 


To  obtain  data  on  this  criterion,  individuals  who  are  familiar 
with  tlie  Jcb  are  asked  to  rate  probable  consequences  of  inadequate  per- 
fonnance  of  each  task  according  to  all  or  a subset  of  such  categories  as 
those  listed  below, 

1.  Negligible 

2.  Trivial 

3.  Rather  trivial 

4.  Not  very  serious 

5.  Fairly  serious 

6.  Serious 

7.  Very  serious 

8.  Extremely  serious 
Disastrous 


9. 
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2. 1.1.4  Task  Delay  Tolerance 

The  delay  tolerance  or  a task  Is  a measure  of  how  much  delay  can  be 
tolerated  between  the  time  the  need  for  task  performance  becomes  evident 
and  the  time  actual  performance  must  begin.  There  are  some  tasks  encoun- 
tered by  job  incumbents  as  part  of  their  normal  job  in  which  no  delay 
can  ever  be  tolerated  between  the  time  the  need  for  task  performance 
becomes  evident  and  the  time  the  actual  performance  must  begin.  The 
job  incumbent  who  encounters  the  task  must  be  capable  of  doing  it,  then 
and  there,  without  taking  time  i.o  read  how  to  do  the  task,  or  find 
someone  to  advise  him  or  taka  over  completely.  For  other  tasks,  a delay 
of  a few  minutes  or  perhaps  half  an  hour  might  be  quite  acceptable, 
or  even  mandatory,  while  the  job  incumbent  gets  advice,  checks  technical 
orders,  regulations,  etc.  And  for  some  tasks,  there  might  be  time  to 
assemble  a group  of  experts  to  confer  before  proceeding, 

The  delay  tolerance  of  a task  is  a measure  of  how  much  delay  can  be 
tolerated  between  the  time  the  need  for  task  performance  becomes  evident 
and  the  time  the  actual  performance  begins.  The  following  are  examples 
of  low  delay  tolerance  tasks  requiring  immediate  performance; 


1.  Use  artificial  respiration  to  restore  the  breathing 
of  an  accident  victim. 

2.  Pull  ripcord  of  emergency  parachute  if  main  parachute 
fails. 

3.  Warn  suspect  of  his  legal  rights  before  questioning. 

4.  Film  historic  occasion  for  official  records. 

5.  Extinguish  fire  in  aircraft  engine  during  startup 
on  flight  line. 


Tasks  determined  to  have  a Iom  delay  tolerance  should  be  given 
relatively  high  priority  for  selection  for  training. 

Exanf>1es  of  tasks  having  a higher  delay  tolerance,  thereby  permitting 
performance  delay,  would  include; 

EXAMPLES 

1.  Review  books  for  unit  llbrary- 

2.  Refill  fire  extinguisher  after  use. 

3.  Advise  major  cotmiand  of  unit  manning  problem. 

4.  Fit  microphones  in  aircrew  oxygen  masks, 

A high  deiay  tolerance  does  not  exclude  a task  from  training,  but 
indicates  that  other  factors  will  be  more  of  a basis  for  acceptance  or 
rejection. 

To  obtain  data  on  this  criterion,  Individuals  who  are  familiar 
with  the  job  are  asked  to  rate  the  amount  of  delay  that  can  be  tolerated 
before  task  performance  begins,  according  to  all  or  a subset  of  such 
categories  as  those  listed  below, 

1.  Extremely  high:  There  is  very  little  requirement  for 
inmedlate  performance 

2.  Very  high 

3.  High 

4.  Rather  high 

5.  Average 

6.  Rather  low 
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8.  Very  low 

9.  Extremely  low:  Task  must  be  performed  inmedlately  whene 
it  is  encountered 

2. 1.1.5  Frequency  of  Performance 

While  the  probable  consequences  of  Inadequate  performance  of  a 
particular  task  are  serious  and  the  task  delay  tolerance  is  low,  the 
task  might  still  rate  low  for  training  priority  if  it  is  rarely 
performed. 

EXAMPLE 

For  a medical  corpsman,  the  task  of  "deliver  baby" 
is  so  rarely  performed  that  it  probably  would  not 
be  trained  in  spite  of  the  serious  consequences  of 
inadequate  performance  and  the  relatively  low  task 
delay  tolerance. 

On  the  other  hand,  if  a task  is  performed  frequently,  the  pay-off 
in  terms  of  return  on  training  dollars  expended  is  likely  to  be  great, 
particularly  if  there  is  a known  "best  way"  to  perform  the  task, 

A practical  way  to  collect  frequency  of  performance  data  on  tasks 
is  to  rate  their  frequency  of  performance  on  a scale  such  as  the 
following: 

1.  Never  perform 

2.  Less  than  once  per  month 

J.  At  least  monthly,  but  less  than  twice  per  week 
4.  Twice  per  week  or  more 


126 


2. 1.1.6  Task  Learning  Difficulty 

Tfie  learning  difficulty  of  a task  refers  to  the  time,  effort,  and 
assistance  re.iu1red  to  achieve  performance  proficiency.  Some  tasks 
encountered  In  each  DOS  are  so  easy  or  so  familiar  that  they  can  be 
readily  "cicked  up"  on  the  job  without  formal  training.  At  the  other 
extreme,  some  tasks  are  so  con^llcated  that  a Job  incumbent  can  perform 
th«n  adequately  only  after  lengthy,  fonrial  training-  Other  tasks  lie 
somewhere  between  these  extremes  and  require  different  levels  of  train- 
ing, Tasks  easy  enough  to  be  "picked  op"  on  the  job  without  ttalning 
might  be: 

EXA.RES 

1.  Sweep  floors. 

2.  Collect  food  ti ays  from  patients  In  hospital 
wards , 

3.  Distribute  unclassified  correspondence  In 
an  office. 

Tasks  requiring  lengthy,  formal  training  might  be: 


EXAMPLES 

1.  Diagnose  malfunction  in  an  airborne  radar 
weapons  system, 

2.  Defuse  une.xploded  enemy  bombs. 

3.  Identify  parasites  in  clinical  specimens. 


To  obtain  data  on  the  criterion  of  task  Teaming  difficulty,  Job 
incunijents  or  others  .night  be  asked  to  rate  tasks  they  perform  as  to 
the  training  time  required  to  achieve  p^of^c1ency,  or  as  to  the  difficulty 
of  "picking  up"  the  task  on  the  job  without  formal  training.  The  following 
rating  scale  might  be  used. 

1.  Extrenwly  low:  No  training  Is  required 

2.  Very  low 

3.  Low 

4.  Below  average 

5.  Average 

6.  Above  average 

7.  High 

8.  Very  high 

9.  Extremely  high;  Training  Is  essential 

2.1.1./  Probability  of  Deficient  Performance 

The  criterion  of  probability  of  deficient  performance  Is  used  to 
insure  that  training  is  given  in  those  essential  Job  skills  In  which 
job  Incumbents  frequently  perform  poorly.  In  any  Job,  there  are 
tasks  that  are  n»re  difficult  to  accomplish  (or  easier  to  bungle)  than 
others.  By  tabulating  the  judgments  of  knowledgeable  personnel  regardtng 
the  pr'^bablllty  of  deficient  performance,  a list  of  these  poorly  performed 
tasks  can  be  produced.  Training  of  these  tasks,  regardless  of  their 
criticality,  must  be  given  serious  consideration. 
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EX/WLES 

1.  If  equipment  downtime  Is  often  caused  by  faulty 
soldering,  this  skill  may  require  additional 
emphasis  in  a list  of  tasks  selected  for  training 
of  repainren. 

2.  If  widespread  theft  of  items  guarded  by  military 
police  is  a problem,  the  tasks  of  "guard  packages, 
materials,  and  property”  and  “prepare  physical 
security  plans"  may  require  additional  emphasis. 

To  obtain  data  on  the  criterion  of  probability  of  deficient  perfor- 
mance, supervisirs  of  job  incumbents  might  be  asked  to  rate  each  task 
as  to  how  often,  according  to  the  scale  below,  subordinates  1n  the 
DOS  perform  the  task  in  an  unacceptable  manner: 

1.  Rarely  if  evri 

2.  Less  often  than  other  tasks 

3.  About  as  often  as  other  tasks 

4.  More  often  than  other  tasks 

5.  Very  often 

2. 1.1.8  Time  Between  Job  Entry  and  Task  Performance 

The  criterion  of  the  time  Interval  between  completion  of  training 
and  performance  of  the  task  on  the  job  has  some  significance  in  selecting 
tasks  for  training.  Here,  the  determining  factors  are: 

1.  Whether  or  not  there  is  a high  probability  of  the  graduate 
encountering  the  task  on  the  Job  fairly  soon  after 
completing  training.  "Fairly  soon"  means,  in  this  context, 
that  tasks  encountered  within  the  first  year  after  training 
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would,  everything  else  being  equal,  be  weighed  more  heavily 
for  selection  than  those  not  encountered  until  one  to  two 
years  later. 

2.  The  pref'icted  or  measured  amount  of  decay  of  the  skill 
that  will  take  place  during  the  time  Interval. 

Vtille  this  criterion  Is  one  of  the  possible  bases  for  selecting  tasks 
for  training,  It  also  Is  excellent  data  for  use  in  Block  1.5:  SELECT 
INSTRUCTIONAL  SETTING.  In  Block  1.5  you  will  decide  when  training  will 
take  place  and  who  will  be  trained;  I.e.,  whether  all  those  in  the  DOS 
or  only  the  individuals  judged  likely  to  perform  the  task  will  be  trained. 
In  Block  1.2,  however,  if  you  are  forced  to  choose  between  two  tasks  that 
are  otherwise  equally  desirable,  you  should  choose  the  one  most  likely 
to  be  required  before  ability  to  perform  the  task  had  decayed  from  disuse. 


EXAMPLE 


The  ability  to  send  and  receive  Morse  Code  Is 
a relatively  difficult  skill  to  acquire.  If 
the  skill  is  not  used,  a considerable  amount  of 
decay  is  certain  to  occur.  If  the  skill  is  only 
rarely  needed  by  personnel,  it  may  be  wise  not  to 
include  the  task  In  the  training  given  to  all 
trainees.  However,  If  the  skill  is  likely  to 
he  used  limediately  after  graduation  by  most 
graduates,  it  probably  should  be  Included  in 
the  training  for  all  trainees. 


To  obtain  data  on  this  criterion  job  incumbents  and  others  might 
be  asked  to  rate  the  time  between  job  entry  and  tisk  performance  on  a 
scale  such  as  the  following: 
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1. 


2. 

3. 

4. 

5. 


6. 


7. 


Task  not  yet  performed. 

Task  first  performed  more  than  4 yeai*s  after  assignment. 

Task  first  performed  between  2 and  4 years  after  assignment 

Task  first  performed  between  1 and  2 yea>^s  after  asslgninent 

Task  first  performed  between  6 months  and  1 year  after 

assignment. 

Task  first  performed  between  3 months  and  6 months  after 
assignment. 

Task  performed  during  first  3 months  of  assignment. 


2.1.2  Choosing  Appropriate  Criteria 

Now  that  you  have  a clearer  Idea  of  the  criteria  you  can  use  In 
judging  which  tasks  to  choose  for  training,  _,ju  are  ready  to  choose  the 
criteria  for  your  specific  list  of  tasks.  Retnember,  you  may  not  wish 
to  use  all  the  criteria  listed,  and  you  may  wish  to  include  criteria 
that  are  not  listed,  Some  of  the  factors  that  will  Influence  your 
choice  of  criteria  are: 

1,  Whether  you  are  likely  to  have  sufficient  resources  to 
train  all  or  most  of  the  tasks  you  think  should  be 
trained. 

EXAMPLE 


If  you  have  scfficient  resources  to  train  all  or 
most  of  the  tasks,  your  primary  concern  will  be 
to  delete  ar\y  tasks  that  clearly  do  not  require 
training,  and  tc  provide  as  nwch  useful  data  as 
practical  for  making  the  instructional  setting 
decisions  in  Block  1.5.  You  probably  will  con- 
centrate on  collecting  data  on  percent  performing, 
time  between  job  entry  and  task  performance,  and 
task  learning  difficulty. 
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2.  From  how  many  people  you  Intend  collecting  data. 


EX««»LE 

If  you  Intend  surveying  3,000  people  for  most  of 
your  data,  you  may  wish  to  collect  data  on  some 
of  the  other  criteria  from  a different,  smaller 
group;  for  example,  perhaps  20-30  experts  in 
that  DOS. 


3.  From  what  types  of  people  you  intend  collecting  data. 


EXAMPLE 

You  probably  will  not  ask  job  Incumbents  the  same 
questions  you  ask  tReir  supervisors.  For  instance, 
data  on  the  criterion  of  probability  of  deficient 
performance  would  be  collected  from  supervisors 
but  probably  not  from  job  incumbents. 


4.  The  nature  of  the  tasks  that  make  up  the  job. 


EXAMPLE 

For  tasks  such  as  combat  tasks,  the  criterion 
of  probable  consequences  of  Inadequate  perfor- 
mance is  of  special  Importance.  However,  for 
routine  clerical  tasks,  this  criterion  is  not 
appropriate . 


5.  Information  already  available. 


EXAMPLE 


The  criterion  of  time  between  job  entry  and  task 
performance,  for  example,  would  not  be  used  if 
existing  doctrine  required  certain  tasks  or  duties 
be  performed  only  after  t.he  job  incumbent  has  been 
assigned  for  a set  period  of  time. 
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6.  Nufliber  of  tasks  that  make  up  the  Job;  i.c.,  number 
of  criteria  you  can  use  without  making  completion 
of  the  questionnaire  too  time  consuming. 

EXAMPLE 


If  the  task  list  is  lengthy,  limit  selection  to 
three  or  fnur  criteria  that  you  consider  essential. 
As  a general  rule,  those  included  in  the  survey 
should  be  able  to  complete  your  questionnaire  in 
approximately  2 hours  or  less.  If  it  takes  much 
longer  than  this,  you  probably  are  imposing  too 
much  tedious  work  on  those  from  whom  you  are 
asking  assistance.  More  valid  data  might  be 
gathered  by  using  any  additional  criteria  on  a 
snialler  number,  perhaps  20-30,  of  other  people 
familiar  with  the  job. 


You  do  not  have  to  use  the  same  criteria  for  all  the  tasks  on  a 
questionnaire. 


EXAMPLE 

If  the  DOS  included  both  coni)at  and  non-conibat 
tasks,  you  might  collect  different  data  for 
different  tasks.  For  the  combat  tasks,  you 
might  ask  for  data  on  probable  consequences  of 
inadequate  performance.  For  the  non-combat 
tasks,  you  might  prefer  to  ask  about  task 
learning  difficulty  or  time  between  job  entry 
and  task  performance.  Also,  you  might  collect 
data  on  time  spent  performing  the  non-combat 
tasks;  however,  this  would  be  less  appropriate 
for  combat  tasks. 


if  you  use  different  criteria  for  different  tasks  limit  the  groups 
of  criteria  to  two  or,  at  the  most,  three.  If  you  list  different  criteria 
for  each  task,  you  will  impose  on  those  who  will  provide  you  with  data. 
Also,  you  will  create  a tremendous  amount  of  work  for  youi'self  both 
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in  preparing  the  survey  forms  and  In  organizing  and  interpreting  the 
collected  data. 

As  was  mentioned  earlier,  one  of  the  outputs  of  this  block  Is  data 
upon  which  additional  decisions  can  be  made  in  Block  1.5.  For  this 
reason  familiarize  yourself  with  that  block  before  you  decide  the  criteria 
on  which  to  collect  data.  To  avoid  conducting  another  questionnaire 
survey  in  Block  1.5,  collect  all  data  here  that  can  more  economically 
be  collected  at  this  point. 

2,2  Select  Sources  for  Survey 

Now  that  you  have  decided  on  the  criteria 
to  use  to  select  tasks  for  training,  determine 
where  you  will  get  data  that  rates  each  of 
your  tasks  for  each  criterion.  First,  decide 
what  categories  of  personnel  you  wish  to 
survey.  If  the  job  with  which  you  are  con- 
cerned is  an  existing  job,  definitely  include 
job  incumbents,  and  probably  supervisors. 

In  sonte  cases,  you  may  need  to  survey  only  recent  job  incumbents  or 
only  experienced  job  incumbents.  For  a new  job  you  may  v,ish  to  survey 
groups  who  do  a similan  job,  subject  matter  experts  (SMEs),  and  instructors. 

Once  you  decide  on  the  categories  of  personnel  to  be  included  in  your 
survey,  determine  your  sample  size  and  choose  specific  units  for  survey. 

Have  a fairly  large  number  of  job  incumbents,  since,  as  a general  rule, 
the  larger  the  number  of  individuals  who  participate  in  the  selection 
process,  the  mere  reliable  the  date.  Details  of  selecting  survey  samples 
were  given  in  Section  2.11,  page  71  of  31ock  1.1. 


i^piill  iiiiiiiiiiiiiiniii ,]]jif||^iiiiiipiiii,nfm 
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It  was  suggested  in  Block  l.I  that  you  would  collect  most  of  the 
data  required  to  make  the  seloction  decision  in  this  block  at  thj  ame 
time  and  with  the  same  questionnaire  with  which  you  validated  your  task 
list  for  Block  1,1.  In  that  case,  your  survey  sources  would,  of  course, 
be  basically  the  same.  Section  2.1  of  this  block  mentioned  that,  for 
several  criteria,  you  might  want  additional  data  from  pertiaps  20-30 
additional  individuals.  If  so,  have  personnel  records  checked  to  locate 
individuals  who  have  the  particular  characteristics  you  want  for  these 
additional  inputs. 

2,3  Prepare  Data  Collection  Forms 
To  obtain  data  that  rates  each  of 
your  tasks  for  each  criterion,  prepare 
an  appropriate  rating  scale  for  each 
criterion.  Examples  of  passible  scales 
were  listed  In  Sections  2, 1.1.1  - 2. 1.1. 8 
of  this  block.  Also,  sample  questionnaires 
are  shown  in  Appendices  C and  B,  pages  100 
and  103  Ci  Block  I.l. 

Notice  that  in  the  scales  referenced  above,  the  higher  numbers  indicate 
a greater  need  for  training, 

EXAMPLES 

1.  In  Section  2. 1.1. 2,  page  119,  "1"  represents  very 
much  below  average  time  spent  on  a task;  "7" 
represents  very  much  above  average  time. 

2.  In  Section  2. 1,1. 3,  page  121,  "1"  represents 
negligible  probable  consequences  of  inadequate 
performance;  "9"  represents  disastrous  consequences. 
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Maintain  this  numbering  system  In  each  of  your  data  collection  fontis 
to  simplify  the  decision  making  process  once  the  data  are  gathered. 

In  most  cases,  the  questionni ire  you  prepare  for  the  job  Incumbents' 
supervisors  will  be  different  from  the  ones  prepared  for  Job  incumbents, 
oven  when  the  same  evaluation  criteria  have  been  selected.  However, 
usually  only  slight  changes  in  wording  are  required. 


EXAMPLE 


To  obtain  "percent  perferming"  data,  ask  the  job 
incumbents,  "Uo  you  perform  this  task?"  Ask  their 
supervisors,  "Do  those  whom  you  supervise,  in  this 
DOS,  perform  this  task.'" 


In  addition  to  the  form  used  to  collect  task  selection  data,  you 
will  need  a form  for  gathering  the  satrie  kinds  of  background  information 
discussed  in  Section  2.4,  page  49,  of  Block  I.l.  An  example  of  such 
a form  is  shown  in  Figure  1.7,  page  50  cf  Block  I.l, 

Collecting  this  background  information  serves  several  important 
purposes . 

1.  Such  information  permits  you  to  chock  back  with  any  of  the 
individuals  to  verify  or  get  additional  data, 

2.  Such  information  penaits  you  to  validate  your  data  if,  for 
any  reason,  the  data  is  suspect. 

3.  Knowing  that  the  accuracy  of  the  information  provided 
can  be  checked,  tends  to  impress  on  the  individuals  being 
surveyed  that  this  is  a serious  and  important  undertaking. 
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4.  Other  important  management  information  can  be  obtained 
with  the  backg'-ound  infomidtion  form.  This  was  discussed 
in  Section  2.4  of  Block  I.l. 

In  addition  to  these  data  collect’ori  forms,  you  must  prepare 
instructions  for  using,  and  instructions  for  administering  the  question- 
naires. Examples  of  instructions  appear  In  Appendix  E,  page  106  of 
Block  T.l. 

2,4  Collect  and  Consolidate  Data 

Now  that  you  have  selected  the  sources 
for  your  survey  and  have  prepared  the  forms 
and  the  instructions  for  their  supervision 
and  use,  conduct  the  survey.  Refer  to 
Section  2.12,  page  72  of  Block  I.l  for 
details  of  carrying  out  this  effort. 

When  you  have  collected  the  data,  you 
are  ready  to  consolidate  it  into  a usable 
form.  You  probably  made  d.ecisions  in 
Section  2.3:  Prepare  Data  Collection  Forms,  as  to  the  general  form  that 
your  corsolidated  data  will  take.  Whether  your  collected  data  is  processed 
by  hand  or  by  machine,  you  must  determine  the  form  of  the  end  product. 
Examples  of  how  you  might  consolidate  the  data  are  given  here. 


I — 1—1 — 
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EXAMPLES 


1.  Assume  you  sent  questionnaires  to  units  In  CONUS* 
to  units  in  Asia,  and  to  units  In  Europe.  You 
used  four  differenL  criteria  for  making  judgments 
as  to  which  tasks  to  choose  for  training;  in  this 
example,  we  will  call  these  criteria  A,  B,  C,  and 
D.  In  each  of  the  three  geographical  locations, 
you  surveyed  both  job  incumbents  and  their  super- 
visors. However,  you  used  only  criterion  A,  B, 
and  C with  the  job  Incumbents,  and  criterion  B, 

C,  and  0 with  the  supervisors.  You  might  consoli- 
date your  data  as  follows: 

a.  Using  the  fonn  shown  in  Figure  1.13,  list  all 
the  tasks  in  the  left-hand  colunm  under  TASKS. 

b.  Calculate  the  mean  (average)  response  from  all 
job  incumbents  for  criterion  A for  the  first 
task.  Enter  this  number  in  the  appropriate 
block  in  the  form.  (The  number  1.C4  has  been 
enteied  in  the  correct  spot  on  the  sample  form.) 

c.  Calculate  the  .-nean  responses  from  all  job  in- 
cumbents for  criterion  A for  each  of  the 
remaining  tasks.  Enter  these  numbers  in  the 
appropriate  columns.  (Arbitrary  numbers  have 
been  entered  in  the  first  column  on  the  form. 

If  we  assume  that  each  criterion  was  rated  on 
a four-point  scale--there  were  four  possible 
responses--then  1.00  would  be  the  lowest 
possible  rating  and  4.00  'he  highest.) 

d.  Calculate  the  mean  responses  from  all  job 
incumbents  for  criterion  B and  criterion  C for 
each  task.  Enter  these  numbers  in  the  correct 
col  umns . 

e.  Repeat  the  above  for  all  supervisors  for 
critericn  B,  criterion  C,  and  criterion  D for 
each  task.  Enter  the  data  in  the  correct 
columns , 

If  you  had  reason  to  believe  the  information  from 
Asia  or  Europe  might  be  significantly  different 
from  that  obtained  from  CONUS,  and  if  such  a dif- 
ference would  be  important  to  you,  you  would  handle 
the  data  somewhat  differently.  The  data  consoli- 
dation form  would  have  six  "responses  from"  columns 
instead  of  the  two  shown  on  our  sample  form. 


RESPONSES  FROM  JOB  INCUMBENTS  I RESPONSES  FROM  SUPERVISORS 
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ation  Form 
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2.  Another  way  to  consolidate  certain  types  of  data  Is 
by  computer  printout  such  as  that  shown  in  l-igure  1,14. 
This  Is  a Comprehensive  Occupational  Data  Analysis 
Program  (CODAP)  printout  for  a weather  technician. 

The  first  column  of  nuirtjers  gives  the  percent  of 
metiters  performing  (see  Section  2. 1.1.1).  The  second 
column  of  numbers  gives  thJ  percent  of  time  spent 
performing  (see  Section  2. 1.1. 2).  The  other  columns 
are  self-explanatory.  Exactly  how  these  nun^ers, 
particularly  those  in  the  second  column,  were  computed 
is  described  in  Appendix  A of  this  block. 


Data  collected  in  surveys  such  as  the  one  discussed  in  this  block 
can  be  consolidated  in  a number  of  different  ways.  The  approaches 
outlined  here  are  only  two  possible  approaches.  Make  sure  you  have  good 
reasons  for  your  choice  of  data  consol idatio.i  techniques,  and  keep  in 
mind  that  the  purpose  of  data  consolidation  is  to  help  you  choose  tasks 
for  training. 


2.5  Delete  Tasks  That  Do  Not  Require  Training 

Once  your  data  is  collected  and 
consolidated  into  a usable  form,  you  are 
ready  to  begin  making  selection  decisions. 

The  first  step  is  to  select  tasks  that 
would  be  trained  if  there  were  no  resource 
constraints.  Do  this  by  deleting  those 
tasks  that  do  not  require  training. 

While  all  task  selection  decisions  are 
a matter  of  judgement;  they  can  be  made 
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confidently  if  you  have  collected  and  organized  meaningful  data. 
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cunuL/.rivc  of  avc  Tine  spcnt  bt  all  ntnecRS 

AVeRAGC  PCRCCNT  Tint  SPCNT  BY  au  nenfltRS 

AW&  X Tift  spunt  by  nenecRS  PCRfomnwG. . 
pcRceNT  Of  fcnecRS  PCfS^osniNG... 


BUTY/TASK  TITLE 

• 

• 

• 

ANSl£R  TCLtPHONt  INdUIRieS  ABOUT  T«  bCATHER 

%.sv 

1.76 

1.75 

1.75 

HAINTAIN  nCTEOROLOGKAL  BATCH 

T5.55 

1.56 

1.1b 

3.16 

U4TI.6RATE  ANALYSIS,  OBSERVATIONS  It  FOWICASTS 

T5.Q0 

1 11 

1.36 

1.5b 

interpret  centrally  prepared  Products  for 

10.76 

1.11 

1.56 

5.61 

TERniNAL  AND  ROUTE  FORECASTS 

PROVIDE  ONROUTE  DESTINATION  i ALT-  FORECASTS 

66. U 

1.1J 

1.5b 

7.11 

PERFORM  SHORT  PERIOD  FORECASTING  OF  FOG, 

11. 

1.3? 

1.55 

6.3b 

stratus,  and  visibiiity 

PERFORM  SHORT  PERIOD  FORECASTING  OF  SURFACE 

15. SI 

1.35 

1.55 

l.bl 

UINDS  AND  LOU  LEVEL  TURBULOKE 

EVALUATE  PILOT  REPORTS 

11.13 

1.31 

1.53 

10.61 

CONDUCT  PILOT  UTfTVCR  BRIEFINGS 

61.15 

1.1b 

1.53 

15.07 

DISSEniNATe  I^ATHER  UARNINGS 

11. 3S 

1.35 

1.51 

13.56 

COrW-ETE  AND  SIGN  litA.,{tR  CLEARANCE  F.nHS 

61.15 

1.11 

1.51 

11.11 

IDENTIFY  AND  EVALUATE  AREAS  OF  SEVERE  WEATHER 

10.76 

1.^1 

1.11 

15. b6 

perform  short  ptriod  forecastlng  of  conden- 

61.31 

1.55 

1.15 

lb. 71 

sation,  PRECIPITATION,  t ICING 

INDICATE  POSITIONS  OF  FRONTS  B.  PRESSURE 

11.07 

1.50 

1.10 

17.61 

SYSTEns  ON  CHARTS 

PERFORM  surface  CHART  ANALYSIS 

11. 3S 

1.11 

1.01 

16.16 

DETERniNE  FRONTAL-ASSOCIATED  WEATHER 

66. 7L 

1.51 

l.D? 

50.  Db 

PREPARE  THLNDERSTORN  i.  HAIL  WARMINGS 

66.16 

1.51 

1.07 

51.13 

EVALUATE  EFFECTS  OF  SURFACE  CONVCC.  HEATING 

66.16 

1.11 

1.05 

55. 

PREPARE  AND  PRESENT  OPERATIONAL  OR  PLANNING 

77. S5 

1.31 

1.01 

53.55 

WEATHER  BRIEFINGS 

PREPARE  SURFACE  WIND  UARNINGS  AND  ADVISORIES 

66.71, 

T..1S 

1.135 

51.51 

DCTERniNE  SOLUTIONS  TO  OPERATIONAL  flETEORO- 

b7.11 

1.51 

1.Q5 

55. 5b 

LOCICAL  PROBLEttS 

ANALYIE  SOLNDING  DATA  ON  THERMODYNAniC  DIAGRAMS 

66.17 

1.15 

1.05 

5b. 56 

USE  PROBABILITY  TABLES  IN  FOREC'STING 

63.6b 

1.51 

1.01 

51.31 

PREPARE  WET  WATCH  ADVISORIES 

6'. .11 

1.50 

1.01 

56.30 

USE  OBJECTIVE  FORECAST  STUDIES  IN  PREPARING 

66.1? 

1.11 

l.Dl 

51.31 

WEATHER  FORECASTS 

COMPUTE  stability  INDICES 

66.7b 

1.11 

0.11 

30.30 

OREINT  AIRCRAFT  IN  FLIGHT 

63.6b 

1.17 

0.16 

31.56 

OPERATE  REPRODUCTION  EiJUlPMENT 

77.53 

1.5b 

0.17 

35.5b 

PERFORM  FRONTAL  ANALYSIS 

b?.bl 

1.10 

0.1b 

33.55 

INTEGRATE  RADAR  AND  PILOT  REPORTS  ON  SURFACE 

b6.17 

1.05 

0.15 

31.17 

ANALYSIS 

LOaTE  AREAS  OF  MECHANICAL  TURBULENCE 

63.  S7 

1.15 

0.11 

35.11 

{NEXT  35  TASKS  OniTTElT 


LOCATE  HEIGHT  OF  TROPOPAUSE 

76.’^ 

0.13 

0.73 

bl.bO 

MAD.TAIN  (HJALITY  CONTROL  PROGRAM 

b5.65 

1.1b 

0.73 

b5.31 

ANALYZE  TFCRMODYNAMIC  DIAGRAMS 

70.81 

1.05 

0.73 

bO.Ob 

F.ONITOR  AfJALYSIS  OF  METEOROLOGICAL  CHARTS 

b3.16 

l.U 

0.71 

b3.?7 

AND  DIAGRAMS 

DETERFlIfC  WIATTCR  PHENOftNA  ON  TTC  BASIS  OF 

71.13 

0.11 

0.71 

b1.16 

VORTICITT  CONCEPTS 

DETERMINE  ADVECTION  TYPES  AND  EFFECT  ON 

74. b1 

0.13 

0.71 

bS.11 

Pf?ESSLIRE  SYSTtnS 


FIGURE  1.14:  Sample  CODAP  Printout 
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EXAS"'LE 

If  very  few  job  incumbents  perfonii  a particular 
task,  and  the  consequences  of  inadequate  performance 
are  neglTgible,  and  there  is  very  little  requirement 
for  the  task  to  Be^performed  imuediately  without 
tine  to  get  assistance  ar:d  advice,  ^nd  the  task  is 
not  at  all  difficult  to  learn,  the  taslt  should  not 
be  trained. 

If  you  consolidated  and  recorded  your  data  as  described  earlier  in 
this  block,  you  may  have  a list  that  looks  like  Figure  1.15.  Of  course, 
you  would  i.jve  included  many,  many  more  tasks,  but  those  listed  should 
serve  as  an  adequate  example. 

First,  look  at  Task  1,  This  could  be  the  task  discussed  in  the 
previous  example.  Notice  that  both  job  incumbents  and  supervisors  arc 
in  general  agreement  as  to  how  the  task  ranks  as  judged  by  the  various 
criteria.  Both  incumbents  and  supervisors  rate  the  task  very  low  on 
all  criteria;  therefore,  you  should  reject  this  task  for  training. 

Now  look  at  Task  4.  Suppose  that  this  task  is  "sweep  floor,"  that 
most  job  incumbents  perform  the  task  but  the  consequences  of  inadequate 
performance  are  negligible,  that  there  is  little  requirement  for  imme- 
diate performance,  and  that  the  task  is  very  easy  to  lea»’n.  This  task, 
in  spite  of  the  large  number  performing,  should  not  be  trained. 

If  you  are  in  doubt  as  to  whether  or  not  a task  should  be  trained, 
it  is  probably  better  at  this  point  not  to  reject  it;  it  probably  will 
be  filtered  out  in  the  next  section.  What  you  are  attempting  to  do 
here  is  to  delete  the  tasks  that  clearly  would  waste  any  training 
resources  devoted  to  them. 


RESPONSES  FROM  JOB  INCUMBENTS  RESPONSES  FROf-;  SUPERVISORS 
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Select  Tasks  for  Trai ni nj 

While  atifllyzintj  data  and  selecting  tasks 
for  training  are  roi|Uired  steps  in  this  block, 
another  step,  that  of  securing  management 
inputs  and  approval,  is  so  closely  related 
that  they  cannot  be  completely  separated. 

The  major  considerations  iti  chouSing  tasks 
for  training  are  costs,  time,  and  other 
resources.  However,  yoj  have  not  been  asked 
to  determine  what  resources  arc  available 
or  iTiay  be  required.  These  are  management 
concerns.  Your  responsibility  is  to  work  as  part  of  a team--of  which 
management  personnel  are  an  important  part--to  select  tasks  for  which 
training  will  be  provided. 

Since,  in  the  last  section,  you  deleted  some  tasks  that  did  not 
require  training,  what  is  left  is  -i  list  of  tasks  that  you  think  should 
be  trained.  At  this  point,  you  need  some  management  inputs  before 
proceeding,  You  may  have  noticed  that  the  next  section  in  this  block 
is  Secure  Management  Inputs  and  Approval.  Actually  it  is  impossible 
to  talk  about  .selecting  tasks  for  training  without  also  considering 
majiagement  inputs.  Here,  >ou  need  to  be  to.d  by  n«nagement  approximately 
what  resources  are  available  for  training  this  particular  DOS  in  urder 
to  knew  approximately  how  many  of  the  tasks  can  be  trained. 

If  the  management  input  indicates  that  all  the  tasks  can  be  trained, 
your  effort  in  this  block  is  completed  and  you  can  move  on  to  the  next 
block.  Unfortunately,  this  is  not  likely  to  happen.  There  probably 


144 


will  never  be  enough  time  and  other  resources  to  train  everything  that 
it  might  De  desirable  to  train. 

Suppose  the  iiianagement  input  indicates  that  75  percent  of  the  tasks 
you  tiiink  should  be  trained  can  actually  be  trained.  If  so,  proceed 
as  follows; 

1.  Select  the  60-65  percent  of  the  tasks  that 

your  data  indicates  are  nwst  in  need  of  training. 

2.  Selec  the  15-20  percent  of  the  tasks  that 

your  data  indicates  a.'c  least  in  need  of  training. 

3.  Rank  order  the  remaining  tasks  from  the  one  you  think 
most  needs  traiiiing  to  the  one  you  think  least  needs 
trai ni ng . 

4.  With  the  above  lists  and  your  rationale  for  ranking 
tasks  as  you  did,  get  back  with  management  and  make 
the  final  selection  decisions. 

Suppose  the  consolidated  data  in  Figure  1.15  is  representative  of 
your  data.  Remember  that  you  already  have  deleted  Task  ! and  Task  4. 
Also  remember  that  the  nunrrfjers  reprerent  the  mean  (average)  response 
from  each  of  the  two  groups  on  each  criterion  and  that  high  numbers 
indicate  more  of  s need  for  training. 

First,  select  the  60-65  percent  of  the  tasks  that  you  think  are 
nx3St  in  need  of  training.  The  reason  for  net  rank  ordering  these  60- 
65  percent  is  that  management  has  already  indicated  that  at  least  this 
many  tasks  will  be  trained.  Rank  ordering  all  tasks  is  a tedious, 
time-consuming  effort  and  should  be  done  only  when  necessary. 
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EXAMPLES 


You  will  notice  that  for  sonie  of  the  tasks  in 
Figure  1.15,  not  only  is  there  a high  level  of 
agreetncnt  in  ratings  of  the  criteria  of  each, 
but  also  the  task*  are  uniformly  given  high 
rankings.  These  tasks  (2.  5,  6,  and  12)  should 
tentatively  be  selected  for  training. 

for  Task  9,  there  is  a high  level  of  agreeinent 
in  ra.nking  the  task,  and  the  task  is  uniformly 
given  a low  ranking.  This  task  should  tenta- 
tively be  rejected. 

For  Task  8,  the  criterion  A rating  is  high,  but 
the  other  criteria  are  uniformly  relatively  low. 

If  criterion  A were  Frequency  of  Performance  and 
the  other  criteria  were  Task  Delay  Tolerance, 
Consequences  of  Inadequate  Performa.ice,  and  Task 
Learning  Difficulty,  you  probably  would  tentatively 
reject  this  task  also. 

Task  7 shows  yet  a different  situation.  Incumbents 
and  supervisors  are  in  general  agreement.  However, 
both  give  the  task  a high  rating  under  Criterion  B 
and  low  ratings  for  all  other  criteria.  Again,  how 
you  judge  this  task  will  depend  on  what  your 
command  considers  important.  If  criterio.n  B were 
Consequences  of  Inadequate  Performance,  you  probably 
would  select  it  for  training. 

At  first  look.  Tasks  3,  10,  and  11  might  leave  you 
undecided.  There  is  a high  level  of  agreement, 
but  the  ratings  are  neither  high  nor  low.  However, 
suppose  Task  11  is  a prerequisite  to  Task  12;  that 
is,  if  one  does  not  know  how  to  do  Task  11,  he  will 
not  know  how  to  do  Task  12.  For  example,  Task  12 
might  be  "verify  that  enemy  bomb  has  been  defused," 
while  Task  11  might  be  "defuse  enemy  bomb."  By 
checking  the  elements  that  make  up  the  two  tasks, 
you  find  that,  if  a person  did  not  know  how  to 
defuse  a bomb,  he  would  not  be  able  to  verify  that 
one  had  been  defused.  On  this  basis,  you  would 
choose  to  train  Task  11  also. 

This  leaves  only  Task*  3 and  10.  Since  you  have 
already  chosen  60  percent  of  the  tasks  for  train- 
ing and  rejected  20  percent,  you  should  rank  order 
the  remaining  tasks.  Since  Task  3 has  slightly 
higher  ratings  under  most  criteria,  put  it  ahead 
of  Task  10, 


Your  list  of  tasks  now  looks  like  this: 


Tasks  selected  for  trainin»j: 

Task  2 
Task  5 
Task  6 
Task  7 
Task  U 
Task  12 

Undecided  tasks  (in  rank  order): 

Task  3 

s Task  10 

[. 

Tasks  not  selected  for  training; 

Task  8 
Task  9 

Remember  that  you  rejected  Tasks  1 and  4 in 
Section  2.5.  Therefore,  they  are  not  listed 
at  all. 

At  this  point,  you  are  ready  to  get  back  with  management  and,  as 
a team,  make  final  selection  decisions.  At  first  It  might  appear  that 
the  only  decision  that  has  to  be  made,  it'  you  continue  with  the  simple 
example  that  was  just  discussed,  is  vdiat  to  do  with  Tasks  3 and  10, 
Which,  if  either,  should  be  trained?  If  the  decision  were  to  train 
Task  3 and  reject  Task  10,  this  would  ntean  701-;  of  the  tasks  would  be 
trained.  However,  several  other  important  factors  must  be  considered. 

1.  The  above  example  assumes  that  the  cost  in  tine,  manpower, 
and  other  resources  are  ^nual  for  all  tasks.  Obviously 
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this  is  not  always  the  case,  i^otne  resource  estimates  will 
be  required  by  managen^nt  from  those  responsible  for  the 
further  development  of  this  particular  program.  TMs  1s 
one  reason  for  not  initially  selecting  the  exact  nunter 
of  tasks  that  management  thinks  can  be  trained.  They  really 
cannot  know  the  exact  nuirt>er  until  they  know  which  tasks  you 
consider  most  important  for  training  and  how  much  It  will 
cost  to  train  these  tasks. 

2.  Much  of  your  selection  data  reflects  the  job  "as  it  is," 
which  is  not  always  the  same  as  "how  it  should  be," 
Management  must  determine  if  "what  is"  is  "what  should  be," 
and,  if  not,  what  kinds  of  changes  are  to  be  made. 


EXAMPLE 


Suppose,  in  selecting  tasks  for  training  Dental 
Specialists,  the  task  of  "service  dental  instruments" 
was  rejected  on  the  basis  of  the  small  percent  per- 
forming and  small  percent  of  time  spent  performing, 
The  reason  more  Dental  Soecialists  did  not  spend 
more  time  performing  this  task  might  have  been  that 
the  currently  used,  newer  dental  instruments  ars 
too  complex  to  be  serviced  by  anyone  who  has  not 
had  special  training. 

If,  as  was  assumed  above,  the  task  was  rejected  for 
training,  there  is  little  chance  that  newly  trained 
Dental  Specialists  will  know  how  to  service  the 
equipment.  This  means,  when  the  job  is  analyzed 
again  seve*'al  years  later,  the  task  again  will 
rate  very  low  on  percent  performing  and  percent  of 
time  spent  performing.  If  no  one  makes  sure  tasks 
selected  for  training  are  based  o;i  "what  should  be" 
rather  than  "what  is,"  the  task  will  probably  be 
rejected  for  training  again.  This  would  nean  that 
considerable  expense  would  be  incurred  in  purchasing 
new  equipment  because  the  original  equipment  was  not 
properly  serviced. 
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The  preceding  example  points  out  the  critical  importance  of  basing 
your  decisions  on  menayement  determinations  of  what  tfiejob  shou1(^J)i; . 


^7 Secure  Mariagemen t Inputs  an^  Approval 

If  you  have  asked  for  and  received  iiianage- 
inent  inputs  os  you  went  through  Section  ;i.C, 
your  tentative  lists  of  tasks,  long  with 
your  rei  oiiinendations  , will  be  close  to  the 
final  product  of  this  block.  While  the 
decisions  will  be  made  by  inanagenietit, 
tlie  quality  of  these  decisions  can  be  no 
better  than  the  c|uality  of  information  and 
rGcomniondations  you  iiave  provided. 


E":i 
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3.0  OUTPIIT.S 

The  outputs  of  tiiis  block  should  consist  of: 


3.1  Products 

1.  Final  list  of  tasks  selected  for  training  (See  page  lag  for 
an  example. ) 

2.  Summary  of  data  collected  upon  which  selection  decisions 
were  based  (See  Figure  1,16  for  an  oxainple.) 


2^2 ^thej2  Uocumentation 

1.  Details  of  data  collection 

a.  Evaluation  criteria  selected  and  rationale  for  selection 

b.  Survey  sources 

c.  Oat'a  collection  forms  used 
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2.  List  of  tasks  rejected  for  training  in  Section  2.5  and 
rationale  fo*"  rejection 

3.  Management  constraints  on  tasks  selected  for  training 

4.  Recommendations  presented  to  management 

5.  Any  other  pertinent  information  not  included  in  the  above 


EXAMPLE 


Final  List  of  Tasks  Selected  for  Training 

A.  Inspect  Main  Transmission 

1.  Inspect  main  transmission  oil  system 

i.  Inspect  main  transmission  thermo-switch 

3.  Inspect  main  transmission  oil  filter  head  assembly 

4.  Inspect  main  transmission  oil  filter 

5.  Inspect  main  transmission  filter  by-pass  valve 

6.  Inspect  main  transmission  oil  chip  detector 

7.  Inspect  main  transmission  oil  hoses 

8.  Inspect  main  transmission  lilies 

9.  Inspect  main  transmission  fittings 


B.  Install  Main  Rotor 

1.  Install  main  rotor  blades 

2.  Ii.jtall  main  rotor  blade  trim  tabs 

3.  Install  main  rotor  blade  bolts 
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APPENDIX  A 


ANALYSIS  OF  JOB  DATA  FROM 
CHECKLIST  TASK  INVENTORIES 
WHICH  USE  "RELATIVE  TIME  SPENT- 
RESPONSE  SCALES 


ANALYSIS  OF  JOB  DATA  FROM 
CHECKLIST  TASK  INVENTORIES 
WHICH  USE  "RELATIVE  TIME  SPENT" 
RESPONSE  SCALES* 


ATSG-EA 
JULY  1974 


*Information  herein  extr.icted/adapted  from  Christal  , R.  E. , "Collecting, 
Analyzing,  and  Reporting  Information  Describing  Jobs  and  Occupations: 
Comments  by  Chairman."  In  Proceedings  of  19'  Division  of  Military 
Psychology  Symposium;  SeV'Jnty-Severth  Annual  Convention  of  the  American 
Psychological  Associafion , Washington,  D.C.,  31  Aug  1969  - 4 Sept  1969. 
AD774575.  pps  77-94. 
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DtRIVATION  OF  "PtR  CENT  OF  JOB  TIME*'  UATA  FROM  "RELATIVE  TIME  SPENT" 

JOB  DATA 


Job  data  (Step  1)  is  obtained  by  job  incuiit)ents  coinpleting  a 
checklist  task  inventory.  Typically  these  task  inventories  contain 
300  to  500  task  statements.  On  each  task,  incumbents  (see  Figure  1) 


Check  ("Check  IF  Done")  the  task  if  they  have  performed  that 
task  and, 

If  performed,  rate  the  task  on  a seven-place  relative  time  spent 
scale.  An  individual  indicates  by  rating  a task  "7"  that  he 
spends  relatively  more  time  on  that  task  than  other  tasks  he 
performs.  A rating  of  "1"  indicates  the  least  amount  of  time 
spent  in  relation  to  all  other  tasks.  In  between  ratings  indi- 
cate various  gradations  between  most  and  least  amount  of  time 


1. 

Evaluate  Work 

2. 

Plan  and  Schedule 

3, 

Change  Dressings 

v/ 

4. 

Make  Beds 

v/* 

5. 

Serve  Meals 

6. 

Take  TPR 

-z* 

7. 

Administer  Fi rst  Aid 

0. 

Administer  Injections 

9. 

Ass  is  t at  Si ck  Cal’ 

IQ. 

Drive  Ambu’iance 

If  Checked,  Ra 
1 Relative  Time  S 
1 Least. .. .Average. . 

te 

pent 
. .Most 

1 

2 

4 

5 

6 

/ 

✓ 





Figure  1.  A completed  checklist  task  inventory  by 
one  respondent  (Case  3). 


Figure  2.  Total 
time  spent  per  task 


2.  In  step  2,  the  relative  ratings  resulting  from  each  respondent 
(Step  1)  are  converted  to  total  or  absolute  times  spent  per  task. 
Example  (see  Figure  2); 

a.  Case  3 rated  5 tasks  (said  he  performed  5 of  the  10  tasks).  He 
rated  these  5 tasks  1,  6,  4,  6,  and  1,  The  absolute  sum  of 
the  rating  is  17  (1  + 6 + 4 5 ^ l). 
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b.  Case  3 spent  1/17  or  5%  of  his  total  work  time  on  the  task 
"change  dressings."  He  spent  6/17  or  34%  of  his  total  work 
time  on  the  task  "make  beds." 

3.  Figure  3 Illustrates  summary  data  resulting  from  10  Job  1ncuirl}ents 
on  the  same  10  Item  checklist  task  Inventory. 

a.  Example  of  how  Average  Time  Spent  by  Members  Performing  (Part  6 
of  Figure  3)  was  obtained.  Two  (20%)  of  the  incumbents  (cases) 
reported  performing  task  1.  They  averaged  spending  75%  of  their 
total  job  time  on  task  1:  Evaluate  work  (80  + 70  r 2 = 75%). 

Four  (40%)  reported  performing  task  4;  llake  beds.  They  averaged 
spending  35%  of  their  total  Job  time  on  this  task 

(40  + 40  + 34  + 25  + 4 = 35%). 

b.  Example  of  how  Average  Time  Spent  by  All  Members  (Part  H,  Figure  3) 
was  obtained.  Only  two  members  ( cases V reported  performing  Task  1. 
The  average  amount  of  job  time  spent  by  all  members  was  15% 

(30  + 70  10  = 15%).  On  task  4,  Make  beds , all  members  averaged 

spending  35%  of  the  work  time  (40  +40+35  + t 10  = 35%). 


H 


F G Average  % 


(A) 

Task 

No 

E 

% 

(per- 

forming) 

1 

(%  ot  Work  Time  Reported  U 
Ten  Cases  for  Each  Task) 

2 3 4 5 6 7 8 

By 

9 

10 

Average  % 
Time 

Spent  By 
Members 
Performing 

T ime 

Spent  By 
All 

MemEiVs 

1, 

20 

80 

70 

75.0 

15.0 

2. 

20 

20 

20 

20.0 

4.0 

3. 

70 

10 

5 

6 

20 

10 

10 

5 

9.3 

6.5 

4. 

40 

40 

40 

34 

25 

35.0 

14.0 

5. 

40 

30 

35 

25 

20 

27.5 

6. 

70 

20 

20 

30 

25 

30 

40 

15 

25.7 

18.0 

7. 

20 

5 

10 

7.5 

1.5 

8, 

60 

5 

5 

50 

40 

40 

10 

25.0 

15.0 

9. 

30 

10 

10 

35 

18.3 

5.5 

10. 

10 

90 

90.0 

9,0 

Figure  3.  Summary  of  Absolute  Time  Spent  by  10  Job  Incumbents  (cases)  on 
10  Tasks. 


FIGURE  1.12;  Flowchart  of  Block  1.2:  SELECT  TASKS/FUNCTIOMo 
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BLOCK  1.3:  CONSTRUCT  JOB  PERFOWWICE  MEASURES* 


OVERVIEW 


Occe  the  decision  has  been  made  as  to  Mhtch  tasks  will  be  trained, 
it  Is  necessary  to  construct  performance  measures  to  test  whether  Indi- 
viduals can  perform  the  tasks.  These  job  performance  measures  (JPMs) 
become  the  fundamental  basis  for  the  development  and  control  of  training 
since  they  are  the  measure  of  the  success  of  training.  Unfortunately, 
manv  tasks,  particularly  combat  tasks,  cannot  be  measured  directly. 

This  results  in  a JPH  being  a compromise  between  resource  constraints 
and  the  requirement  for  high  predictive  validity  or  fidelity. 


♦Portions  of  this  material  have  been  adapted  from:  Swezey,  R.  W.  and 

Pearlstein,  R.  B.  Developing  criterion  referenced  tests  (287-AR18(2)-IR- 
0974-RWS).  Reston,  Va.:  Applied  Science  Associates , September  1974. 
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The  procedures  in  31o(,k  1.2,  SELECT  TASK/FUNCTIONS , produced  a list 
of  tasks  selected  for  training.  In  this  block,  you  will  construct  .Job 


Performance  Measures  (JPMs)  for  those  tasks.  JPMs  test  whether  or 
how  well  an  individual  can  perform  tasks. 

A JPM  is  written  at  the  task  level.  It  renresents  the  best  approxi- 
mation to  a perfect  test  that  can  be  made,  considering  costs,  time,  and 

ability  to  measure.  A JPM  measures  one  or  more  complete  tasks.  Job  | 

Performance  Measures  are  used  to:  1 

1.  Separate  people  into  two  groups:  those  who  can  satisfactorily  j 

i 

do  the  task  and  those  who  cannot  i 

j 

2.  Serve  as  the  fundamental  basis  for  development  and  control  j 

of  training 

3.  Control  the  quality  of  tne  output  (graduates)  of  training 

4.  Form  the  gasis  for  skill  qualification  tests,  tests  for 
promotion,  tests  to  ensure  that  units  are  in  an  appropriate 
state  of  readiness,  and  any  other  measures  of  DOS  proficiency 

Using  JPMs  for  all  of  the  .ibove  assures  some  degree  of  compatibility 
in  the  training,  evaluation,  and  personnel  management  systems  and  this 
multiple  use  justifies  the  investment  required  to  construct  and  validate 
(make  sure  they  test  what  they  are  supposed  to  test)  the  JPMs.  Because 
so  much  depends  on  JPMs,  a heavy  responsibility  is  placed  on  those  who 


construct  and  validate  them. 
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Wtjile  a JPM  tests  performance  or  a task,  a Job  Performance  Test  is  a 
test  used  to  determine  whether  or  how  well  an  individual  can  perform  a 
job.  A Job  Performance  Test  may  Include  either  all  of  the  JPMs  for  a 
particular  job  or  a subset  of  the  JPMs. 

Wtile  Job  Performance  Tests  are  usually  constructed  by  other  s , the 
Job  Performance  Measures  developed  here  will  be  the  basis  for  such  tests. 

1.2  Definition  of  Teims 

Following  are  definitions  of  and  brief  discussions  of  some  of  the 
important  terms  used  in  this  block. 

1.2.1  Predictive  Validity 

A JPM  is  said  to  have  good  predictive  validity  if  those  who  score  high 
or  pass  the  JPM  are  those  who  can  perform  the  task  well.  The  ideal  JPM 
would  have  perfect  predictive  validity.  Without  exception,  those  who 
passed  the  JPM  could  perform  the  task,  and  all  those  who  failed  the  JPM 
could  not  perform  the  task. 


EXAMPLES 


1. 


One  of  the  tasks  of  a 
complete  the  DA  Forms 
and  maintenance.  The 
to  the  task.  In  this 
the  JPM  woul d be  very 


Motor  Transport  Operator  is  to 
associated  with  vehicle  operation 
JPM  for  this  task  is  identical 
case,  the  predictive  validity  of 
high. 
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2.  Another  task  of  a Motor  Transport  Operator  is  to  drive 
a 5-ton  truck  with  a trailer  from  a specified  point  to 
a specified  destination.  The  task  conditions  require 
driving  under  a variety  of  conditions.  The  JPM  is: 

Action:  Drive  vehicle  with  trailer, 


Conditions 


Standards 


a.  Over  a di tch 

b . Over  a rock  bed 

c.  Over  a sand  trap 
a.  Down  a steep  slope* 

e.  Dp  a steep  slope 


without  getting  stuck 
without  getting  stuck 
without  getting  stuck 
using  proper  gears  and  brake 
action 

using  proper  gears 


In  this  case,  the  predictive  validity  probably  would 
still  be  reasonably  high.  If  an  individual  passed 
the  test,  he  probably  could  oerform  the  task.  If  he 
failed  the  test,  he  probably  could  not  perform  the 
task. 


When  it  is  practical  to  measure  the  task  as  it  is  actually  performed 
on  the  job,  it  is  possible  to  determine  the  predictive  validity  of  the 
related  JPM.  In  these  cases,  the  primary  objective  in  developing  JPMs 
is  to  achieve  the  highest  possible  predictive  validity,  while,  at  the 
same  time,  keeping  testing  costs,  time,  and  safety  within  acceptable 
1 i mi  ts , 

Often  paper  and  pencil  tests  can  have  high  predictive  validity. 

There  are  two  types  of  paper  and  pencil  tests  which  are  particularly 
suitable  for  measuring  performance.  The  first  type  concerns  those  tasks 
that  are  accomplished  by  using  paper  and  pencil,  e.g.,  a unit  cormander 
reviewing  a strength  report  prior  to  authentication.  In  the  performance 
of  this  task  the  job  incumbent  in  the  real  world  uses  paper  and  pencil. 
The  performance  measure  for  this  task  therefore  would  have  to  use  paper 
and  pencil.  Other  examples  are  filling  out  forms  and  coding  entries 
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into  data  systems.  Because  they  use  paper  and  pencil  In  the  real  world, 
thel-  OPMs  should  be  paper  and  pencil  tests. 

The  second  type  of  task  where  a paper  and  pencil  test  would  be  appli- 
cable Is  one  in  which  a mental  discrimination  is  the  most  inportant 
aspect  of  the  task.  An  example  of  this  type  might  be  the  selection  of 
an  avenue  of  approach  tor  an  infantry  attack.  Assuming  that  the  student 
is  provided  adequate  information  concerning  the  weather,  eneniy,  and 
terrain,  and  that  there  were  only  six  viable  avenues  of  approach  with 
one  clearly  be^t,  there  would  certainly  be  no  strong  objection  to  having 
a paper  and  pencil  test,  even  in  multiple  choice  formal  (with  6 possible 
responses)  requiring  the  student  to  select  the  most  appropriate  avenue 
of  approach  based  upon  the  conditions  given.  This  is  a medium  high 
physical  fidelity  test  of  the  student's  ability  to  select  an  appropriate 
avenue  of  approach  and  yet  it  is  in  a multiple  choice  paper  and  pencil 
format- 

The  major  difference  between  the  conventional  multiple  choice  items 
and  the  use  of  a multiple  choice  format  for  performance  testing  of  this 
type  task  is  as  follows: 

1.  Conventional  riultiple  choice  items  generally  utilize  a 
short  stem  with  little  if  any  supporting  reference  material 
available.  Performance  items  in  a multiple  choice  format 
generally  have  longer  detailed  stems  (which  normally  include 
the  environment  of  the  JPM)  and  always  provide  for  use  of 
any  references  available  on  the  job. 

2,  Conventional  items  generally  limit  choices  to  4 or  5 op- 
tions while  the  number  of  options  on  a performance  based 
multiple  choice  test  vary  and  are  dictated  by  the  number 
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of  options  available  in  the  reel  world.  The  option  of  doing 
nothing,  for  exan^le,  would  normally  be  e reasonable  field 
option  but  is  rarely  included  in  a conventional  item. 

1.2.2  Physical  Fidelity 

The  physical  fidelity  of  a JPM  refers  to  the  extent  that  the  actions, 
conditions,  cues,  and  standards  of  the  JFM  approximate  those  of  the  tasic. 
In  the  first  example  in  the  previous  section,  the  JPM  lias  the  highest 
possible  physical  fidelity:  JPM  performance  is  identical  to  task  perfor- 
mance. Tho  second  example  has  lower  but  still  reasonably  high  physical 
fidelity.  However,  with  these  two  examples,  predictive  validity  ir. 
more  important  than  physical  fidelity.  If  a paper  and  pencil  test  or 
some  other  tescing  approach  with  considerably  lower  physical  fidelity 
could  be  shown  to  have  practically  the  same  predictive  validity,  and 
if  this  testing  approach  were  preferable  in  terms  of  cost,  time  and 
safely,  it  should  be  used.  Unfortunately,  having  high  physical  fidelity 
does  not  ensure  that  predictive  validity  will  be  high.  However,  if  pre- 
dictive validity  cannot  be  used,  one  must  often  settle  for  high  physical 
fidelity. 


EXAMPLE 


A gunner's  mate  must  engage  and  hit  attacking  eiierriy 
high-performance  aircraft  according  to  a specific 
procedure  and  with  a high  degree  of  skill.  This  is 
a task  for  which  he  trained  and  which  has  inmense 
payoff  for  the  mission  if  it  is  done  well.  In  order 
to  determine  whether  he  can  or  cannot  perform  this 
task,  he  would  have  to  be  tested  and  given  a "go" 
or  a "no  go."  This  testing  would  have  to  be  given 
under  the  exact  conditions  that  would  exist  on  the 
real  job  in  combat. 
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Circumstances  prevent  the  administration  of  the  test 
under  real  world  conditions.  First,  it  would  be 
difficult  to  knoit  which  of  a battery  of  gunners  is 
responsible  for  a hit.  Second,  no  one  ^ill  be  avail- 
able to  administer  the  test.  Third,  it  would  be 
foolhardy  to  administer  a test  under  such  dangerous 
conditions . 


In  this  example,  predictive  validity  cannot  be  used  to  determine 
the  quality  of  the  JPM  for  that  task.  Since  there  is  no  way  to  test 
the  task  under  real  world  conditions,  there  is  no  way  to  test  pre- 
dictive validity.  In  cases  like  this  the  quality  of  the  JPM  is  often 
based  on  the  degree  of  physical  fidelity  between  the  JPM  and  the  task. 

Figure  1.17  is  a graphic  presentation  of  some  of  the  possible 
degrees  of  fidelity  between  JPMs  and  tasks. 


FIGURE  1.17.  Degrees  of  Physical  Fidelity  Between  JPMs  and  Tasks 


These  three  situations  could  represent  the  rhree  examples  used 
earlier.  In  the  first  example,  performance  of  tne  JPM  for  completing 
DA  Forms  was  identical  to  performing  the  Transporl  Operator's  task. 
This  is  like  "a"  in  the  figure.  In  the  second  nxai.iple,  the  JPM  for 
driving  the  5-ton  truck  with  a trailer  has  reaso.ubly  high  physical 
fidelity,  but  its  performance  is  not  identical  to  ihu  task.  This  is 
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like  "b"  in  the  figure.  In  the  last  sicuacion,  the  JPM  for  the  gunner's 
mate  will  have  to  be  considerably  different  from  the  actual  task.  The 
physical  fidelity,  of  necessity,  will  be  lower.  This  is  like  "c"  in  the 
figure. 

1.2.3  Simulation 

Simulation,  broadly  defined,  is  any  change  from  reality,  or  any 
imitation  of  reality.  When  a test  cannot  be  given  under  real  world 
conditions,  some  form  of  simulation  must  be  used. 


EXAMPLE 


A light-weapons  infantry  task  might  involve  engaging 
enemy  ;,o’diers  under  combat  condi*'ions;  that  is,  the 
soldier  himself  would  he  In  jeopardy.  Without  a war, 
an  enemy  connot  be  provided  to  engage.  We  would  not 
endanger  tlie  soldier's  life  by  having  hii,:  under  fire 
just  to  test  his  performance.  Therefore  we  cannot 
provide  a high  fidelity  initiating  cue;  the  soldier 
will  not  be  shot  at,  nor  will  he  have  to  seek  oui 
enemy  troops.  There  is  no  way  to  supply  the  sane 
element  of  danger  without  truiy  endangering  him.  The 
JPM  would  be  more  like  "c"  in  Figure  1.17.  However, 
we  can  simulate  the  initiating  cue  and  have  him  go 
through  some  or  most  of  the  steps,  and  we  might 
provide  battle  sounds.  The  initiatin.g  cue  can  range 
from  an  order  to  fire  at  a paper  target  to  the  ap- 
pearance of  a simulated  figure  (there  is  one  called 
Punchy  Pete)  that  will  appear  randomly  and  fall  if 
hit  in  a critical  spot. 


In  this  example,  the  battle  sounds  provided,  the  paper  targets,  or  the 
"Punchy  Pete,"  and  any  ouier  imitations  of  the  real  world  task  are 


simulation. 
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1.2.4  Unitary  Tasks 

Another  factor  that  effects  construction  of  JPMs  is  whether  t>"?  task 
is  unitary  or  multiple.  A unitary  task  is  one  that  is  always  performed 
in  exactly  the  same  way  with  exactly  the  same  inputs. 


CXAf^PLE 

"disassemble  an  M16  rifle"  and  "assemble  an  M16 
rifle"  are  unitary  tasks.  The  input,  the  rifle  is 
always  the  same;  and  the  task  is  always  performed 
in  the  same  way. 

1.2.5  Multiple  Tasks 

A multiple  task  is  one  that  has  a number  of  possible  inputs.  There 
are  two  types  of  multiple  tasks.  One  type  is  always  performed  by 
following  basically  the  same  procedure. 


EXAMPLE 

A task  requiring  multiplication  of  three-digit  numbers 
by  three-digit  numbers  is  a multiple  task.  The  mul- 
tiplication is  always  performed  by  following  basically 
the  same  procedures;  however,  there  are  almost  one 
million  possible  inputs  or  combinations  of  the  two 
sets  of  three-digit  numbers. 


In  this  example,  it  would  be  impossible  to  test  all  possible 
inputs  to  make  sure  an  individual  knows  how  to  do  them  all,  For 
unitary  tasks,  the  JPM  can  measure  the  total;  however,  for  multiple 
tasks  a representative  sample  must  be  used. 

The  other  type  of  multiple  task  is  one  in  which  the  inputs  vary, 
and  the  task  is  perfoniied  differently  depending  on  the  input,  This 
means  the  input  is  a cue  that  determines  the  appropriate  response. 
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EXAMPLE 


One  task  for  a Military  Policeman  is  to  apprehend  a 
violator.  The  procedure  for  performing  the  task 
depends  heavily  on  the  cues.  For  example: 

I ; the  suspect  armed  or  not? 

If  the  suspect  military  or  civilian? 

Is  the  suspect  drunk  or  sober? 

Is  the  suspect  in  a vehicle  or  on  foot? 

Is  the  suspect  alone  or  with  others? 

Is  the  MP  alone  or  with  others? 

Is  the  MP  in  a vehicle  or  on  foot? 

Did  the  alledged  crime  take  place  in  a restricted 
area  or  not? 

Answers  to  questions  like  these  will  determine  hov/ 
the  task  is  performed, 


As  with  the  first  type  of  multiple  task,  the  JPM  for  this  task 
cannot  measure  the  total  task  but  must  test  a sample  of  the  possible 
variations,  liowever,  for  this  type  of  task,  the  JPM  must  do  more  than 
measure  the  adequacy  of  the  performance.  It  also  must  measure  the 
appropriateness  of  the  performance;  that  is,  whether  the  performance 
was  the  correct  responses  to  the  particular  cues, 

1.3  Overview  of  Construction  of  JPMs 

JPMs,  like  tasks,  are  statements  of  action  to  be  taken.  JPMs  also 
have  a statement  of  conditions  under  which  the  JPM  is  adn.inistered, 
cues  that  indicate  the  need  for  particular  responses,  standards  that 
are  a measure  of  the  adequacy  of  performance,  and  elements  that  are  the 
actions  that  make  up  the  total  perfonnance. 

As  was  mentioned  earlier,  the  inputs  to  this  block  were  the  tasks 
selected  for  training,  along  with  their  conditions,  cues,  standards,  and 
elements.  The  procedure  for  developing  JPMs  is  basically  one  of 
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considering  in  what  ways  the  JPM  must  be  different  from  the  task,  because 
of  various  testing  constraints,  and  constructing  a test  that  is  the 
best  compromise.  The  steps  in  this  procedure  are  shown  in  Figure  1,18, 
the  foldout  page  at  the  end  of  this  block.  The  outputs  of  this  block 
will  include  a JPM  for  each  task. 

2.0  PROCEDURES 

Follov-'lng  are  a number  of  steps  in  the  procedure  for  developing 
and  validati.ng  JPMs . For  the  steps  discussed  in  Sections  2.1  - 2.9, 
the  cor'^ect  procedure  is  first  to  go  through  these  steps  for  each  task. 
That  is,  take  o^  task,  determine  the  testing  contraints,  make  the  various 
decisions  discussed  in  Sections  2.2  thru  2.8,  and  develop  the  JPM.  Then 
take  Uie  next  task  and  do  the  same.  The  first  decisions  will  be  tentative 
after  you  '.ave  worked  through  a small  group  of  tasks,  you  may. wish  to 
go  back  and  make  changes-  Then,  after  you  have  developed  all  of  the 
JPMs,  and  scoring  procedures,  validate  the  items  as  discussed  in  Section 
2.10. 


2.1  Determine  Testing  Constraints 

If  there  were  no  constraints  of  time, 
money,  personnel,  facilities,  and  other 
resources,  every  JPM  could  be  identical  to 
the  task  it  is  intended  to  measure.  That 
is,  the  JPM  would  consist  of  observing 
ttie  job  incumbent  while  he  perfonned  the 
task  on  the  job  and  noting  whether  or  not 
lie  met  the  job  standards.  However,  since 
these  constraints  do  exist,  the  JPM  often 
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will  be  different  from  the  task.  The  first  step  in  developing  JPMs  that 
have  high  predictive  validity,  high  physical  fidelity,  or  both  is  to 
analyze  the  task  to  determine  what  testing  constraints  apply  to  that 
particular  task.  The  following  practical  constraints  can  force  a change 
from  a higher  to  a lower  physical  fidelity  JPM,  Note  that  these  constraints 
are  all  interrelated.  For  example,  time  availability,  manpower  availability 
equioment  availability,  and  costs  are  often  all  dif^^erent  aspects  of  the 
same  problem. 

1 ■ Time.  The  first  type  of  practical  constraint,  time  availability 
is  easily  understood.  Often  the  situation  is  such  that  it  is  impractical 
to  test  the  task,  as  it  is  stated,  in  the  available  time, 

EXAMPLES 

Perhaps  the  job  task  requires  an  extended  march 
through  marshy  terrain  during  inclement  weather 
or  watching  a radar  scope  for  blips  for  long  per- 
iods, maintaining  proper  vigilance  as  indicated 
by  detecting  all  blips  during  the  interval. 

Since  botn  of  these  examples  would  take  much  too 
long  to  test  in  most  situations,  they  must  be 
modified  to  permit  testing  in  less  time. 

In  general,  time  limits  must  be  placed  on  test  administration  which 
in  turn  limits  the  amount  of  time  that  can  be  spent  on  each  JPM.  If 
performance  of  some  of  the  tasks  requires  more  time  than  is  available 
for  testing,  the  JPM  can  use  a sample  of  the  task  elements, 

L’.  Manpower.  Manpower  availability  can  also  impose  practical 


constraints . 
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EXAi^LE 


If  under  nor'mal  conditions  it  takes  4 men  to  operate  a 
main  battle  tank,  a commander,  drivjr,  gL.)ner,  and  a 
crewman/ loader,  and  you  want  to  test  assistant  crewman/ 
loaders  under  normal  operational  conditions,  personnel 
trained  ■‘n  the  functions  of  commander,  gunner,  aid  driver 
will  be  required  for  the  test.  If  these  personnel  are  not 
available,  there  will  be  insufficient  manpower  for  con- 
ducting the  assistant  crewman/] oader  test  une'er  normal 
operating  conditions. 


In  the  above  example,  it  would  be  preferable  to  arrange  JPMs  for  the 
whole  crew  simultaneously,  but  care  must  be  taken  to  ensure  that  each 
position  is  scored  separately. 

3.  Costs.  Cost  is  another  important  factor  in  developing  JPMs. 

The  cost  of  test  administration  must  be  Kept  within  the  limits  dictated 
by  the  testing  budget  of  tlie  facility  wiiere  the  test  will  be  used. 


EX.WLE 

It  would  be  entirely  too  costly  (and  unreasonable)  to 
have  a demolition  specialist  destroy  a bridge  to  test 
his  ability  to  achieve  maximum  damage.  There  must  be 
other  more  practical  means  of  testing  this  task.  If 
the  task  specifies  demolishing  a bridge,  the  JPM  may 
need  to  be  modified  so  that  the  bridge  is  not  actually 
demolished,  but  the  job  incumbents  demonstrate  the 
process  up  to  but  not  including  the  demolition, 


4.  Facili ties/ equipment.  Often,  sufficient  equipment  or  facilities 
are  not  available  for  test  administration.  This  is  especially  true 
for  sophisticated  equipment  and  very  specialired  facilities. 
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EXAMPLES 

A serious  facility  constraint  exists  when  a Job 
incumbent  must  demonstrate  competence  in  escape  and 
evasion  in  a tropical  jungle  if  the  testing  must 
take  place  in  the  Southwestern  United  States.  An 
extreme  example  of  a facility-caused  constraint  is 
firing  a missile  down  range,  since  at  many  test 
sites  it  is  impossible  to  obtain  a suitable  test 
range. 

An  example  of  a severe  practical  constraint  concerning  equipment 
availability  might  involve  a course  on  troubleshooting  a terrain-following 
radar  system.  The  preferred  JPM  may  include  planning  a bug  in  the  system 
and  having  a Job  incumbent  locate  the  problem  and  replace  or  repair  the 
necessary  parts.  However,  this  radar  system  is  sufficiently  complex 
and  costly  that  testing  is  prohibited  on  the  actual  equipment.  Another 
example  is  troubleshooting  a computer-:  The  downtime  of  the  computer  may 
be  so  costly  as  to  negate  its  use  for  testing  purposes. 

If  you  have  many  tasks  for  which  testing  would  tax  facilities/equipment 
beyond  feasible  limits,  it  may  be  possible  to  select  for  testing  those 
tasks  which  would  cause  least  damage  or  inconvenience,  The  remainder  of 
the  tasks  might  be  simulated. 

5.  Other  constraints.  There  are  other  less  common  practical  con- 
straints which  you  may  encounter  in  the  development  of  your  tests.  These 
constraints  include; 

1.  logistics 

2.  supervisory  effectiveness 

3.  communications 

4.  ethical  considerations 

5.  legal  considerations 


iwuii'ifliipvnuiiTiiutwftiinni'mriiiTriiflniiW'^ 
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Remember  that  in  most  cases  constraints  are  interrelated.  The  prac- 
tical constraint  In  the  example  of  the  terrain-following  radar  system 
was  categorized  under  equipment  availability,  but  it  could  also  be 
categorized  under  costs. 

Considering  the  limitations  in  equipm-int,  personnel,  time,  space, 
safety  requirements,  and  other  factors,  it  is  obvious  that  complete 
fidelity  is  not  always  practical  or  even  desirable.  In  these  cases, 
the  JFM  developed  must  be  viewed  as  the  best  possible  trade-off  with 
reality. 

If,  for  your  particular  task,  nj  constraints  exist  that  prevent  you 
from  using  the  actual  task  as  the  JPM,  you  will  not  be  forced  to  make 
trade-offs.  Fortunately,  quite  a fev;  tasks  fall  into  this  category, 

EXAMPLES 

1.  The  JPM  for  "rotate  tires  on  1/4-toti  truck"  could 
be  identical  to  the  cask. 

2.  The  JPM  for  "complete  DD  Form  314,  Preventive 
Maintenance  Schedule  and  Record"  probably  would 
be  identical  to  the  task. 

2.2  Determine  if  Product,  Process,  or  Both  Shoul d be  Measured 

The  task  standard  was  based  on  a 
product,  process,  or  both.  This  was 
discussed  in  detail  in  Section  1.2.7 
of  Block  I.l 

The  end  product  is  the  most  obvious 
task  output;  it  can  be  observed  and 
inspected.  A tactical  operation  plan. 
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a computer  program,  or  the  results  of  a desk  audit  of  an  initial  draft 
computer  program  are  all  products  or  tenninating  boundaries  of  tasks. 

The  other  output  which  signals  the  terminating  boundary  of  a task 
is  the  completion  of  the  process  involved.  The  process  itself  leaves 
no  record.  The  skills  involved  (for  instance,  in  driving  a tank)  can 
best  be  evaluated  by  observation. 

In  some  cases,  product  and  process  must  both  be  examined  as  task 

output.  Many  tests  evaluate  processes  which  result  in  products  in  order 

to  provide  feedback  on  process  errors  which  effect  the  product  or  related 
policies  and  practices. 

In  certain  cases,  processes  in  a task  may  be  critical  in  that  they 
insure  personnel  safety  or  prevent  equipment  damage.  For  instance,  a 
driver  may  arrive  at  destination  B from  point  A as  required  by  the  task 
but,  in  the  process,  violate  many  laws  and  safety  regulations.  In  such 

cases,  product  evaluation  by  itself  is  not  always  adequate. 

The  JPM  will  usually  measure  the  same  factors,  product,  process,  or 
both,  used  as  a basis  for  ttie  task  standard;  however,  this  is  not  an 
essential  practice.  If  considerable  simulation  will  be  required,  it 
may  be  more  practical  to  measure  another  factor. 

EXAMPLE 

The  standard  for  the  Demolition  Specialists'  task 
of  "denwlish  bridges"  might  be  that  ne  completely 
destroy  the  bridge  without  injury  to  himself.  The 
JPM  would  probably  measure  the  procedure  used  rather 
than  the  product. 
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LA  Dotennine  Simulator  Regul remerU j 
Sitnulation  is  defined  broadly  as  any 
cliange  from,  or  imitation  of  reality. 

However,  sitice  bit.ulatioti  as  u result  of 
changes  in  conditions,  cues,  and  standards 
will  be  discussed  in  the  following  sections, 
only  changes  in  the  basic  task  related 
equipment  or  facility  are  discussed  here. 

Earlier  it  was  stated  that  there  are 
occasions  in  which  no  JPM  can  be  given 
under  actual  job  conditions  because  of  cost,  danger,  etc.  But,  some 
tasks  are  so  important  to  mission  success  or  must  be  done  so  well  that 
failure  to  satisfactori ly  perform  them  significantly  reduces  the  chances 
of  mission  success,  endangers  lives,  or  damages  equipment.  The  function 
of  this  section  is  to  d*scuss  the  development  of  simulators  used  princi- 
pally for  JPHs  for  the  evaluation  of  job  incumbents,  not  for  instructional 
purposes.  However,  there  is  always  the  possibility  of  using  the  simulator 
for  both.  Remember  the  Apollo  missions  v;ere  flown  successfully  by  men  who 
had  been  trained  and  tested  on  si.mulators . 

Each  service  has  its  ov^n  procedures  for  specifying  and  developing 
requirements  for  simulators.  Ordinarily,  these  would  have  been  generated 
when  the  new  process  or  system  was  still  on  the  drawing  boards. 

EXAMPLE 

Experience  gained  by  our  forces  or  by  others  can 
luickly  change  the  requirement  for  job  proficiency. 

In  the  1967  Arab-Israeli  conflict,  there  were 
improvements  in  range  and  shooting  accuracy  of 
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the  tankers  based  on  WW  II  data.  Between  1967 
and  the  Yotn  Kippur  war,  range  and  accuracy 
increased  dramatically  again. 

These  changes  in  perfonnanco  were  traced  directly 
to  training.  In  order  to  tnaintain  the  ability  to 
engage  eneny  armor  successfully  dt  tiie  increased 
levels  of  proficiency  required,  laser  simulators 
were  developed.  These  high  fidelity  devices, 
such  as  Multiple  Integrated  Laser  engagement 
Simulator  (MILES),  permit  accurate  scoring  of  hits 
and  provide  excellent  opportunities  to  measure  the 
performance  of  crews  under  simulated  combat 
conditions. 


The  requirements  for  these  simulators  were  not  specified  at  the  time 
that  the  main  battle  tank  was  delivered.  The  requirement  resulted  from 
careful  analysis  of  field  perfomance  by  crav  and  experience  gained  by 
others.  The  JPM  developer  will  often  discover  needs  for  increasing  the 
fidelity  of  JPMs  based  on  critical  new  information  of  the  type  described. 
If  he  is  a specialist  in  the  DOS  in  question,  he  may  know  from  his  own 
experience  of  deficiencies  in  performance  that  could  make  important  dif- 
ferences to  mission  accomplishment.  Occasionally  field  use  of  hardware 
and  systems  indicates  the  need  for  improved  job  performance,  or  unanti- 
cipated system  perfonnance  or  configurations  require  a reordering  of 
tasks  selected  for  training.  In  those  situations,  the  developer  of 
the  JPMs  should  investigate  the  potential  value  of  a simulator  in  the 
total  system. 

The  use  of  simulators  for  training  will  be  discussed  further  in  the 
sections  of  the  n'.anual  dealing  with  the  development  of  instruction. 

Many  trade-offs  may  be  necessary  in  order  to  arrive  at  good  decisions 
about  the  procurement  of  simulators.  (Some  of  these  would  be  directly 
tied  to  training  considerations,  time  saved,  cost  of  simulators  compared 
to  alternative  means,  and  other  factors.) 
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Three  loyistical  factors  will  have  a direct  bearing  on  a decision  to 
use  sinHilators: 

1.  Downtitre.  What  is  the  effect  on  the  readiness,  effectiveness, 
and  efficiency  of  the  unit  .;hen  operational  personnel  or 
equipment  is  used  fo»  measuring  performance? 

2.  Cost.  What  is  the  cost  of  using  personnel,  equipment,  and 
materials  resources  for  measuring  performance? 

3.  Damage  or  Danger.  Wltat  are  the  potential  damages  or  dangers 
to  personnel  or  equipment  as  a result  of  the  performance 
measurement? 

As  the  JPM  is  designed  for  each  task  on  youi  list,  you  should  consider 
each  of  the  above  logistical  factors.  .Rate  each  as: 

1.  Serious ■ It  has  major  consequences  to  mission  operations. 

2.  Average . It  has  moderate  consequences  to  mission  operations, 

3.  flegl igible.  It  has  little  consequence  to  mission  operations. 

If  in  rating  the  factor  with  regard  to  the  three  logistical  factors  (down- 
time, cost,  damage  or  danger),  you  find  that  none  of  the  factors  are  rated 
"serious"  and  no  more  than  one  of  the  factors  is  rated  "average,"  you 
cannot  justify  large  expenditures  for  a simulator  for  the  JPM.  However, 
if  .rost  of  the  factors  are  rated  "serious"  or  "average,"  you  should  give 
serious  consideration  to  the  use  of  a simulator. 

Another  consideration  is  the  lead  time  to  procure  simulators.  If 
the  JPM  is  designed  requiring  a simulator  that  will  take  years  to  go 
through  the  approval,  design,  and  production  cycle,  it  will  not  be  useful 
six  months  from  now  when  you  are  conducting  external  evaluation. 
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If  It  is  determined  that  simulation  is  required,  you  must  decide  what 
type  of  sinuilatioi)  is  necessary.  For  some  purposes,  tfie  roseinblanco 
should  be  very  close.  For  other  purposes,  high-fidelity  simulation  is 
not  necessary.  TItree  coiniran  types  of  simulatior  are; 

Simulating  Part  of  the  System.  You  may  want  to  explore 
questions  of  operator  performance,  safety  features,  etc. 

To  do  this,  you  may  decide  to  create  a mock-up  of  a par- 
ticular piece  of  gear.  The  sophistication  of  tlie  mock-up 
will  vary.  In  many  situations,  fully  operational  or  high- 
fidelity  mock-ups  or  trainers  are  not  required,  Situations 
requiring  full-scale  t*-ainers  are  usually  determined  in  the 
early  stages  of  system  design,  The  trainer  design  and 
development  is  usually  accomplished  by  a contractor, 

2.  Simulating  the  Operation  of  a System.  System  operation  can 

be  simulated  in  several  ways.  One  tsclinique  is  "talk-tlirough , 
or  a computer  can  be  used  to  simulate  operational  activities; 
or  complex  simulators  can  replicate  the  job  conditions. 

The  characteristics  of  the  first  two  techniques  are  shown 
in  Table  1.5. 

3 . ^i_m_uj  atinq  th  e Env  i ronment  in  Which  the  System  Hill  Ope  rate. 
The  most  frequent  source  of  error  in  modern  systems  is  due 
to  variability  in  human  performance , You  may  use  a variety 
of  techniques  for  determining  under  what  conditions  people 
v.'i  n have  difficulty  operating  the  system.  One  way  is  to 
let  real  people  operate  the  system  using  simulated  inputs. 

Cy  simulating  system  inputs,  you  can  create  stf'essful  situa- 
tions (for  exa;iinle,  an  overload  condition)  and  observe  what 


TABLE  1,5 

5 i mu  Id  ting  tin*  Operdlionul  SystiMii 


TALk-TllkOIJtlH  fECIKilQUE 

COfIPUTEk  MODELS  TECHNIQUE 

Involves  talking  through 
each  operation  in  the  new 
si'stem  to  determine  deci- 
sions and  contingencies. 

Involves  having  a coirputer 
simulate  the  major  opera- 
tions of  the  system,  under 
a variety  of  conditions. 

Resul ts ; 

Resul ts : 

* Depicts  human  functions 
at  flowchart  level. 

* Functions  of  system  and 
assumptions  of  personnel 
performance  are  reduced 
to  logic  statements. 

* Major  decisions  are 
rationally  identified. 

* The  iiwde!  of  the  system 
is  "run"  many  times 
under  different  condi- 
tions , 

* Ref|uired  actions  and 
alternatives  are 
rationally  determined. 

* Shortcomings  of  system 
operation  are  identified. 

* Information  gaps  requir- 
ing assumptions  are 
i denti  fi  od. 

happens.  Such  techniques  are  particu1a'."'ly  useful  for  Identi- 
fying in  advance  the  iiii.stakcs  people  make.  If  they  occurred 
in  actual  operation,  these  iiii.stakes  might  be  very  costly. 
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2 . 4 _ Uoiertnine  JPM  Conditions 

Conditions  may  be  constant  or  they  may 
vary;  this  includes  factors  that  cannot  he 
controlled,  such  as  weather  and  the  amount 
of  natural  light,  and  factors  that  can  be 
controlled.  All  such  JPM  conditions  shouiJ 
be  listed. 

EXAMPLE 


ACTION; 

Foi  Lite  tash  "rcinove/instal  1 main  transmi  sc  ion 
mast  assembly"  on  an  OH-58  Helicopter,  the 
condi Lions  1 is.ed  are: 

COMDITIOHS: 

Sheltered  area 
TM  55-1520'22’8-20 
rr.  55-1520-228-35 
General  mechanics  tool  kit 
Suitable  mai ntenan..e  platform 
suitable  stand  to  bold  masi 
Wrencli  T1G1500 
Holding  Fixture  TlOl-199 


The  above  conditions  are  fairly  constant;  in  order  to  do  the  job, 
you  .-/ould  choose  to  have  all  of  the  above,  tn  sucn  ca  JPM  conditions 
motcii  job  condi  tivons.  For  other  jobs  the  ~onditions  must  be  s unpled  for 
any  one  JP.M  It  is  difficult  to  combine  b'-zzards  <.nd  desert  in  one 


iiioasure . 
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EXAMPLE 


A lai'^d  nevi gallon  task  would  be  to  get  fi'om  point  A 
to  point  B.  The  constant  conditions  listed  are: 


A map  of  the  locale 
Lensatic  compass 

The  variable  conditions  are: 


All  types  of  weather 
Across  all  terrains 
At  any  time  of  day 


In  developing  the  JPM,  all  the  conditions  that  would  make  a dif- 
ference in  performance  of  the  JPM  must  be  listed  for  each  factor,  'n 
the  previous  examples,  in  addition  to  the  fixed  conditions  of  a map 
of  each  locale  and  a lensatic  compass,  there  must  be: 

1.  All  possible  types  of  weather--dry,  damp,  rain, 
snow,  clear,  high  wind,  lioiht  wind,  no  wino,  below 
freezing,  temperate,  hot,  etc. 

2.  All  types  of  terrains--p'»ains , cities,  deserts, 
forests,  towns,  villages,  hills,  mountains,  etc. 

3.  Any  ti me--day time , nighttime  w^th  stars,  no  stars, 
moon , no  moon , etc. 

if  testing  constraints  preclude  using  all  the  conditions,  you  will 
be  forced  to  use  a sample  of  them.  You  should  include  these  conditions 
you  t'^ink  will  best  reflect  ability  to  perform  under  all  the  conditions. 


Best  Available  Copy 
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2.5  Pptennlne  JPM  Cues 

Often  the  JPM  cues  must  be  different 
from  the  task  cues  even  though  this  reduces 
the  fidelity  of  the  JPM. 

EXAMPLE 


The  cue  for  a medical  corpsman  to  perform  mouth- 
to-mouth  resuscitation  would  be  that  the  casualty 
was  not  breathing.  However,  this  would  not  be 
a realistic  cue  for  the  JPM,  While  changing  the 
cue  reduces  the  fidelity  of  the  JPM,  probably 
the  best  that  could  be  done  would  be  to  use  a cue 
such  as  having  the  test  administrator  say,  "At 
this  station,  the  casualty  (duimiy)  next  to  you 
is  uncoiiscious . Vou  find  a weak  pulse.  He  has 
stopped  breathing.  iniiiediate  action." 


Insofar  as  constraints  permit,  the  critical  cues  should  be  realistic. 
A critical  cue  is  one  for  which  the  proper  response  determines  success  or 
failure  in  petTorning  the  task. 


EXAMPLE 


The  task  of  "repair  malfunctioning  equipment"  might  be 
such  that  the  actual  repairs  are  relatively  simple  if 
you  know  which  one  to  make.  The  critical  part  oF  the 
tack  might  be  determining  which  repair  to  make.  In 
Lliij  onample,  if  the  JPM  cue  were  having  the  test 
administrator  say,  "Assume  equipment  requires  repair 
A,"  the  JPM  would  have  very  low  fidelity  and  probably 
very  low  predictive  validity. 
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2,6  Deteniiine  JPM  Standa rds 

Perfonnance  measures  must  have  specific 
standards  which  are  applied  to  all  persons 
taking  the  test  so  that  each  perron  is 
rated  like  all  others.  JPM  standards 
usually  include  time  limits  and  required 
procedures;  some  will  describe  the 
product  requi  ed  and  criteria  for  judging 
that  product.  Time  limits  simply  mean 
that  the  skill  must  be  performed  correctly 
within  a certain  time.  The  time  limits 
may  be  set  by  the  cask. 


EXAMPLE 


After  you  remove  the  pin  from  the  hand- 
grenade  and  release  the  handle,  there  is 
a fixed  number  of  seconds  before  the  grenade 
explodes.  The  time  limit  for  Lossimj  it 
must  be  well  within  that  time  limit. 


Other  standards  may  also  be  set  by  the  task 


EXAMPLE 


A fragmentation  grenade  of  the  M26  or  M5G 
type  has  an  effective  casually  radius  of 
15  meters.  It  can  be  thrown  approximately 
40  meters  by  the  average  soldier.  The  stan- 
dard for  distance  thrown  must  be  set  some- 
what over  15  meters  but  cannot  be  set  over 
40  meters  if  you  want  achievable  standards. 
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Some  standards,  especially  time  limits,  are  not  job  directed.  That 
Is,  these  tasks  rate  very  high  on  Task  Delay  Tolerance.  In  addition  to 
having  Implications  for  training,  this  factor  also  affects  performance 
testing. 


EXAMPLE 


One  of  the  more  probable  sources  of  a performance 
standard  Is  that  developed  by  the  test  designer  or 
perfonnance  evaluator.  For  example,  it  may  be  that 
there  are  no  verifiable  real-world  job  performance 
speed  requirements  that  liave  ever  been  discovered. 
"Change  wheels  on  L-ton  trucks"  may  be  required  of 
a driver.  However,  if  we  add  the  condition  of 
"muddy  terrain"  and  the  standard  "within  three  minutes," 
we  may  have  used  the  test  to  set  the  standard  when 
there  was  no  standard  implied  in  the  task.  It  might 
be  troublesome  if  the  driver  requi»*ed  two  hours  to 
perfonn  the  task,  but  what  if  it  only  took  six  minutes? 
To  the  statistician  that  means  being  off  by  a factor 
of  100t!--a  powerful  error;  but  to  the  driver,  it  may 
be  only  a minor  problem.  Unless  there  are  real  f 1 el d 
requirements  for  stated  conditions  and  standards , they 
?hould  ordinarily  be  stated  to  the  minimum  requirement. 
In  the  case  of  changing  wheels,  it  may  be  necessary  to 
do  a time  and  motion  study  just  to  discover  a 3-m1nute 
tire  changing  procedure,  when  almost  anyone  could  do 
it  in  6-10  minutes . 


Such  unnecessarily  high  standards  are  very  costly  in  testing  efforts 
and  of  dubious  value  in  decision  naking. 

Standards  relating  to  procedures  require  that  certain  steps  be 
followed  in  the  performance  of  the  task.  If  certain  steps  are  omitted 
or  done  in  the  wrong  order  when  order  is  important,  then  the  person  does 
not  meet  the  standard.  The  idea  behind  the  use  of  such  a standard  is 
that  there  is  no  such  thing  as  perfonning  some  skills  half-right  and 
half-wrong.  Either  a person  can  stand  at  attention  or  he  cannot;  there 
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Is  no  half-way  point.  Soine  performance  measures  may  include  a margin  of 
error.  For  example,  a performance  measure  in  land  navigation  may  allow 
a soldier  to  plot  an  azimuth  within  a tolerance  of  plus  or  minus  two 
degrees.  If  his  answer  falls  within  that  range,  he  has  met  the  standard. 
Other  tests  may  allow  a person  to  vary  the  order  in  which  he  performs 
certain  steps  of  a procedure,  because  the  order  is  not  critical. 

Some  standards  may  include  requirements  related  to  final  products. 
Sometimes,  procedures  followed  in  turning  out  the  end-product  may  be 
less  important  than  the  quality  of  the  product  itself.  However,  if 
procedures  are  followed  correctly,  the  chances  that  the  product  will 
meet  the  standard  should  be  improved. 

Some  jobs  could  be  measured  on  both  process  and  product, 


EXAMPLE 


If  the  product  is  a graded  road,  i u could  be 
scored  based  on  a set  of  criteria  such  as 
bank  slope,  ditch  slope,  crown,  surface 
appropriate  to  the  terrain  and  intended  use. 
(See  the  following  illustration.) 


riu  SECTION 
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Another  class  of  performance  standards  arc  highly  quali'.auve,  such 
as  those  for  briefings,  staff  studies,  and  tactical  plans.  The  effec- 
tiveness of  an  oral  briefing  is  difficult  to  break  down  into  elements 
that  can  be  objectively  scored  on  a right  vnor.g  bad:.  A ..uhber  of 
tactical  plans  might  be  good;  some  may  be  better;  but  only  one  may  be 
best.  Evaluation  of  their  worth,  however,  is  Judgmental  and  qualitative 
rather  than  quantitative.  You  must  be  careful  when  you  evaluate  such 
intellectual  and  qualitative  task  performances  to  be  sure  that  you  do 
not  just  measure  the  less  important  part  of  the  tasks  that  arc  more 
easily  scored.  Even  though  evaluation  of  these  tasks  is  mostly  judg- 
mental and  qualitative,  a quantitatively  measurable  standard  for 
performance  measurement  purposes  must  be  derived. 


EXAMPLE 


L.'iassfxjom: instruction  can  be  based  on  military 
standards  like: 

Classroom  is  clean. 

Instructor's  shoes  and  brass  are  shined. 
Instructor  varies  the  volume  of  his  voice,  etc. 

Additionally,  standards  can  Include  performance 
levels  for  the  instructor's  trainees; 

The  trainees  will  make  a score  of  75% 
or  above  on  the  posttest. 

The  trainees  will  reach  criterion  in 
less  than  one  week. 
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c.  7_  Detennine^  if  A11_  or  P<jrt_ of  the  Tajk  JJi  1 1 Be  Tested 
Tfie  dec ib ion  to  test  all  or  part  of  the 
tabk  depends  larijely  or'  whether  it  is  a unitary 
task  or  a multiple  task.  For  unitary  tasks, 
that  is,  tasks  that  have  only  one  docti-inally 
correct  procedure,  all  of  the  task  is  tested. 


EXAMPLE 


^.■-1 

tr-l 


m 


..  I _ 


A unitary  task  is  making  VOR  receiver  check, 

VOR  RECEIVER  CHECK 

Check  the  VOR  receiver  during  the  "Before  Taxi 

Checklist"  using  the  following  procedure: 

1.  Tune  and  identify  the  station--! isten  for  the 
voice  or  Morse  code  identifier. 

2.  lienter  the  course  indicator  with  a 'lO  indi- 
cation by  slowly  rotating  the  course  selector. 

3.  Move  the  course  selector  10°  to  the  left.  The 
course  indicator  should  deflect  (move)  all  the 
way  to  the  right.  Then  move  the  course  selector 
lO'-’  to  the  right  of  the  original  course.  You 
should  note  full  deflection  of  the  course  indi- 
cator to  the  left.  This  procedure  ensures  free- 
dom of  movement  of  the  course  indicator. 

A.  Move  the  course  selector  90°  from  the  original 
course.  The  TO  indication  should  disappear,  and 
the  from  indication  should  begin  to  appear.  This 
procedure  ensures  that  the  ambiguity  (whether  you 
are  going  to  or  from  the  station)  features  of  the 
VOR  are  working. 


In  the  above  example,  all  of  the  task  is  tested  and  the  JPM  is 
basically  identical  to  the  task. 
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EXAMPLES 

1. 

2. 


If  a task  includes  multiplying  three-digit 
numbers  by  three-digit  numbers,  there  are  almost 
one  million  possible  combinations.  You  will 
test  only  a part  of  this  task. 

If  the  task  is : 

Job  task  (OH-58  Helicopter  Mechanic)  4,119/5 

Task;  Troubleshoot  Main  Transmission  Oil  System 
Conditions;  1)  Outside  if  weather  and  lighting 
permit  or  under  shelter 

2)  TM  55-1520-228-20 
TM  55-1520-228-34 
General  mechanics  tool  kit 
Pressure  gauge  0 to  100  lbs  psi  and 
mul  time  ter 

3)  OH-58  Helicopter 

Standards;  1)  Locate  and  isolate  the  cause  oi  any 
abnormal  indicators  within  (time 
frame) 

2)  Observe  safety  precautions 
The  JPM  might  be: 

Job  Performance  Measures  for  Task  4.119/5 

Task:  Troubleshoot  Main  Transmission  Oil  System 

Conditions:  1)  Outside  if  weather  and  lighting 

permit  or  under  shelter 

2)  TH  55-1520-228-20 
TM  55-1520-228-34 
General  mechanics  tool  kit 
Pressure  gauge  0 to  100  psi  and 
mul  time  ter 

3)  OH-58  Helicopter 

Standards:  l)  Locate  and  isolate  the  cause  of  the 

following  abnormal  indicators. 

(1) 

(2) 

(3) 


(n) 

2)  Observe  all  safety  precautions 

3)  Locate  and  isolate  within  (time  frame) 

If  there  are  only  three  or  four  abnormal  indicators,  you 
win  probably  include  them  all  in  one  test.  If  the 
nuitber  of  possible  abnormal  indicators  is  large,  you  may 
construct  alternate  forms  of  the  JPM,  each  of  which 
includes  several  of  the  possibilities. 
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3.  The  multiple  task  "identify  MOS  and  grades  to 
announce  for  pronotion  reconiiiendations"  might 
look  like  the  flowchart  {Logic  Tree)  in 
Figure  1.19.  To  perfonn  this  task,  some  of  the 
first  steps  are: 

Detennine  if  the  position  is  authorized  E4,  E5, 
and  £.6. 

Determine  if  the  position  is  vacant. 

Are  tiiere  individuals  on  the  merit  list? 


For  each  answer  to  thesf  questions  there  is  a 
different  path  to  take.  Any  one  case  would  only 
go  on  one  of  the  possible  paths.  However,  there 
are  a finite  number  of  cases  that  will  test  all 
possible  decision  points  and  paths.  This  number 
of  cases  makes  up  the  pool  from  which  you  can 
construct  alternate  forms  of  tlie  JPM. 


Look  at  your  list  of  actions,  standards,  conditions,  cues,  and 
constraints.  What  can  you  realistically  do?  If  you  can  test  the 
whole  task,  do  it.  If  not,  develop  a part-task  test  that  will  predict 
job  perfonnance.  You  will  validate  these  measures  and  have  an  oppor- 
tunity to  revise  them  later.  The  next  section  discusses  a sampling 
plan  for  use  with  part-task  tests. 

H Develop  Sampling  Plan 
At  this  point,  you  have  identified 
tasks,  conditions,  cues,  and  constraints, 
made  a decision  on  testing  whole  or  parts 
of  each  task,  and  specified  what  output(s) 
you  will  measure.  For  all  those  factors 
listed  above  that  are  unitary  • -ent 


FIGURE  I.I9:  Logic  Tree 
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only  one  option)  i there  is  no  need  to  sample;  use  that  factor.  Wiien 
there  are  multiple  possible  actions,  conditions,  or  cues,  you  must  decide 
if  they  are  all  equal ly  likely  to  occur  and  if  there  is  the  same  criti- 
cality Involved  iwlth  the  occurrence  of  each  one.  If  they  are  equal, 
sample  equally  from  them  until  each  is  included  in  one  alternate  form 
of  the  JPH. 


EXAMPLE 

Task:  field  Strip  an  M?03  Grenade  Launcher 

Conditions:  Night,  day;  rain  or  shine 

Initiating  cues;  Malfunction  x.  y,  or  7 (all  equally 
likely  to  occur) 

Standard;  ’’n  2 minutes 

for  your  sampling  plan  you  would  choose  the  one  acMon 
and  coiribine  it  with  each  of  the  selected  conditions  and 
each  initiating  cue.  fhere  are  two  choici;s  for  each 
condition  and  three  initialing  cues  so,  to  test  all  of 
them,  you  will  have  six  JPMs. 


If  the  likelihood  of  occurrence  or  the  criticality  is  unequal,  tften 
the  sampling  plan  should  reflect  that. 


EXAMPLE 


Task;  Troubleshoot  the  engine  in  an  Orl-X^ 
Conditions:  TM  XXX 

m xxx'_ 

To^S 
5hel  ter 

Initiating  Cues:  Mai  function-.,  A-G , H-P,  Q-? 

Standard;  OH  XXJ(  must  function 
For  your  sampling  pTan  you  would  chouse  tne  action, 
condHions,  and  standard  from  the  task  list.  Eighty 
percent  malfunctions  that  occur  are  A-G,  10  [lerccnt 
are  H-P,  and  10  percent  ore  Q-Z  Tn  addition  mal- 
functions H-P,  if  no'  corrected  iimiediately , will 


lyo 

dL'struy  Lht’  enqim';  whiln  iiiaifuMctioMS  i)-/  ludkc 
tHrriblc  noisei.  but  do  not  cuuso  pernidnotit  ddiiiaije. 
Tor  L'dch  dltcrridte  fonn  of  the  'IPM,  you  nnqht  pldti 
to  tdke  4 inal  turn:  t ions  from  the  A-fi  group, 

L'  From  the  H-P  group,  and  1 from  the  Q-/  group, 

You  need  to  weigh  the  likelitiood  of  occurrence  and 
the  criticality  of  tlie  malfunction  to  decide  fiow 
many  to  ' dniple  from  e.,ch  group. 


Several  of  the  above  examples  use  the  term  "alternale  fonn  of  the 
JPM, " these  alterna'te  forms  are  equal  but  different  versions  of  the 
ilPfl.  Constructing  oltcrndt('  fonts  makes  it  possible  to  include  all 
of  tlie  imoortant  variables  witiiout  making  any  single  test  too  long 
to  administer.  However,  occasionally,  it  is  not  practical  to  constrcut 
alturnaLo  forms  because  cf  LlU!  large  number  of  variables  involved. 


EXAMPLE 


If  the  task  included  multiplying  three-digit 
numbers  by  three-digit  numbers,  there  woulo  be 
almost  one  million  possible  multiplication 
problem  . It  would  be  impi'actieal  to  construct 
enough  alternate  forms  of  the  JPM  to  include  all 
nt  these. 


Ir  the  above  example,  a predetermined  ,|uantity  of  randomly  selected 
numbers  could  be  used  for  the  JPM.  In  that  way,  no  one  would  know, 
until  the  testing  began,  which  njinbers  would  be  selected. 

This  e.xd'iiple  raises  a critical  question:  Why  not  initially  select 

three  or  four  problems  sucfi  as: 


9f!7  X 639  =•  ? 

609  X 713  = ? 

and  let  these  be  the  JPM?  fhe  reason 
uses  of  JPHs  is  to  serve  as  the  basis 


542  X 861  - ? 

484  X 275  = ? 

is  that  one  of  the  important 
for  the  training  progr'aiii.  This 


a 


i 
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■neanr  the  training  program  will  be  designed  to  teach  people  to  pass 
the  JPM.  If  the  four  problems  listed  above  '.vere  the  only  ones  included 
in  the  IPM,  they  might  be  the  only  ones  taught.  Even  if  other  problcfns 
were  taught,  there  would  be  no  way  to  know  they  had  been  learned  since 
they  are  not  in  the  JPM. 


^.9 Construct  JPMs  and  Scoring  Procedures 


K 

ii 


ri 

ii 


2.9,1  Document  JPMs 

r 

— 1 

Once  you  have  completed  the  steps 

[ 

i*.' 

k' 

t 

outlined  in  Sections  2.1  through  2.8, 

.cn 

} 
t ■ 

construction  of  your  JPM  is  largely 

1 

— 

!• 

complete.  All  that  remains  is 

. r 

K- 

documenting  your  decisions  and 

aeveloping  a procedure  for  scoring 



.,1-  _ — . 

x:: 


n 


X 

o 


Documenting  JPMs  is  quite  similar  to  documenting  tasks  (see 
Figure  1. 10,  Block  1,1),  Like  tasks,  JPMs  have  conditions,  cues,  and 
standards.  JPMs  also  have  procedural  steps  that  often  are  similar  to 
elements.  The  same  form  used  to  document  tasks  can  be  used  to  document 
JPMs.  Figure  1.20  is  an  example  of  a JPM  written  on  such  a form.  By 
attaching  each  JPM  to  the  corresponding  task  documentation,  a complete 
package  of  information  is  made  available  upon  which  the  training  program 
can  be  based. 


2.9.2  Develop  Scoring  Procedures 

There  are  two  basic  means  of  obtaining  a record  of  each  job 
incumbents  performance.  The  approach  required  depends  upon  the  nature 
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FIGiRE  1.20:  ExampMe  of  JPM  Documentation 


JOB  LATA  WORKSHEET 


% 

XI  o 
% C 

1 QJ 

41  x: 

(O 

t/l  i- 
O 
3 

p—  O 

>»  0>  s 

^ cv. 
3:  O -to 
n (T3  4J 
J-  0)  f— 
U.‘  1/1  ' - 

•;•■>  Q ,n  3 

<U  </^ 

0)  4-J  c»  ^ 


•M 

if\  13 

•o 

l/> 

U C 

OJ 

• 

•« — *<— 

3 >» 

•‘x: 

c 

O XJ 

41  u 

o 

>v 

4J 

1— 

QJ  tv 

- "O 

ro  </> 

4-» 

XI  QJ 

QJ 

■*u  - 

4J 

-k->  Q. 

*>  > 

■o 

to  >, 

^— 

(0  OJ 

QJ 

C U1 

QJ  -r- 

3 

, r 

.cr 

O QJ 

4J  »— 

p—  <a  • 

X 

E 

■XJ  4> 

•r— 

•1—  3 cn 

QJ 

•1— 

•M  t. 

4-J 

i-  tJ  i/> 
CU  -r- 

+•»  <U  t. 
1/1  x: 

0)  J--  «/) 


5 - 

t.  o » 

4’  C U 


^ u 

Z:  OJ 

u-  x:  o 

UJ  » -M  4J 

ox:  c 

q:  -M  o -r- 

O ro  c 

u_  <u  a ^ 

J-  O r- 
::*  x»  J*-  r- 
o rti  a 
O C', 

ca  <u  ^ 0) 

‘•^v  QJ  4J  U 

rc  -o  a tv 


• X3  •— 
^ rrj 
UJ  »■  £ 

1—  “O  C 
QJ  O 

— J ^ c 
r>  1/1 


a uo  5 
UJ  »r-  O 
r— 

LiJ  C X2 
»—  o 
O 'r-  c 
UJ  o o; 

CC  ro  x: 

r-  h- 
-J  fT3 

I—  X ■ 

ZL*  OJ  Oi 
C 
OJ  o 

UJ  -C  t- 

rc  4J  ■»-> 

t—  LO 

<c  c 

UJ  QJ  *0 

a:  jz  c 




rv  cj:  ta  o 


194 


cf  th?  task  to  be  tested,  from  a scoring  point  of  vi(»w,  tiie  best  per- 
foniiance  measure  is  one  which  permits  the  job  holder  to  produce  the  record 
of  his  tested  performance.  Such  records  would  include  the  holes  in  a 
practice  target,  the  correct  assetrihly  of  a piece  of  equipment,  the  elim- 
ination of  a known  fault  in  a system,  and  proper  procedures  on  a telet''pe. 
All  these  perforniances  leave  eviden>e  or  records  that  can  he  scored  by 
evaluators  in  an  objective  fashion.  These  also  have  high  physical 
fidelity  with  the  job  tasks,  lor  instance,  hits  on  a practice  target 
are  a record  of  performance  on  a task  with  only  slightly  less  fidelity 
than  the  iiits  on  an  enemy  position. 

Some  tasks  will  not  provide  a record  of  performance.  Knowledge- 
able supervisors  or  SMEr.  will  be  required  to  either  observe  the  job 
incumbent's  perfonm  ce  or  to  inspect  a produced  product  in  order  to 
ebtaio  the  record  of  performance. 

Othe^  'asks  involve  e'ivipment  and  may  require  the  job  incumbent  to 
oerfonn  a series  of  procedural  steps.  An  observer  is  required  to  record 
performances  on  each  essential  step.  Some  tasks  will  require  the 
incumbent  to  produce  a product.  For  many  of  these  products,  the  record 
of  performance  can  be  obtained  only  from  an  inspection  of  the  product  by 
a qualified  supervisor. 

Developing  scoring  procedures  involves  determining  the  most  appro- 
priate procedures  for  recording  the  adequacy  of  the  product,  process, 
or  both.  Following  are  some  guidelines  in  the  form  of  discussions  of 
techniques  for  scoring  products  and  processes,  various  types  of  rating 
scales,  and  variocs  types  of  co.anon  scoring  errors  and  reasons  for  each, 
Based  on  these  guidelines,  you  should  develop  and  document  the  scoring 
procedure  for  each  JPM. 
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^9 . 2j.  1 Product  kating  Method 

Since  the  product,  unlike  the  performance,  is  usually  a tangible 
ooject,  product  rating  is  mone  reliable  than  process  rating.  The  example 
in  Figure  1.21  shows  a product  scale  for  rating  ability  to  fly  a simu- 
lator (link  trainer).  The  pilots  being  tested  are  required  to  fly  a 
pattern  that  corresponds  with  the  pattern  shown  at  A.  By  comparing  the 
product  with  the  standard  provided  in  the  scale,  the-  rater  can  measure 
the  product.  If  followed  carefully,  this  procedure  can  eliminate  nearly 
al 1 rating  errors . 


LINK  TRAINI  T »*MODUCf  C 

1 

1 

t 

0 1 

i. 

u 1 

iS 

A 

TK.NDAMD) 

FIGURE  1.21:  Fxamplo  of  Product  Scale  for  Rating  Proficiency  in  Simulator 

These  are  tracings  from  a link  trainor  recording  device. 

The  ones  to  the  left  of  A are  inadequate. 

In  developing  a scoring  procedure  for  a product,  identify  as 
accurately  and  specifically  as  possible  the  scorable  characteristics. 
Identify  specific  characteristics  that  distinguish  a satisfactory  pro- 
duct from  an  unsatisf actory  one.  If  the  product  is  1o  be  ineosured  by 
so:ne  kind  of  instru'ient,  identify  the  characteristics  to  be  measured 
ann  orovide  the  scorer  with  the  specific  insti'uctions  for  making  tlie 
measurenien t.  On  the  basis  of  che  standard,  decide  what  is  a passing 
score.  If  the  standard  does  not  provide  clear  guidance,  revise  it  until 
i t does . 
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,'.9.?. 2 . P/f'''P5S_  Ratjn^  Methods 

A qood  scoring  procedure  for  process  measu.  eirient  will  provide  the 
scorer  with  explicit  directions  on  what  the  exa''iince  should  be  doing 
at  each  stage  in  the  JPM.  A detailed  step-by-step  description  of  the 
process  by  which  the  JPM  is  perfonned  will  provide  a basis  for  scoring. 
The  various  actions  required  can  be  written  in  checklist  farm. 

Regardless  whether  the  output  is  a product  or  a process,  some 
form  of  rating  scale  is  generally  used  to  rale  performance,  following 
is  a discussion  of  some  of  tliese  scales. 


Ciiockl  ists 

A checklist  is  useful  for  recording  the  performance  of  a set  proce- 
dure. The  example  in  n.jure  I .?2  shows  a portion  of  a checklist  for 
rating  instrument  flying  profi cicncy . In  using  the  checklist,  the  observer 
indicates  whether  ‘tie  completion  of  each  step  was  satisfactory  or  unsatis- 
factory. Creaking  a perfoniiarice  into  several  observable  elements  greatly 
reduces  error. 


I 


-CHECKLI51- 

INSTRUCT IONS : If  the  performance  is  satisfactory 
place  a + sign  in  the  space  provided.  If  the  per- 
fonnance  is  unsatisfactory,  place  a - sign  in  the 
space, 


1.  Maintains  constant  heading  . . . 
(within  5®  of  course) 

2.  Maintains  constant  altitude.  . . 
(within  50  feet) 

3.  Can  make  a timed  turn  (gyros  . . 
caged)  (within  10^  of  new 
headi ng) 

4.  Can  make  a steep  turn  (within.  . 
50  feet  of  al ti tude) 


n 

□ 

□ 

□ 


FIGURC  1.22:  Example  of  Checklist  for  Rating  Proficiency  in  Instrument 

Flying 
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Relidliillly  is  usually  hiijh  in  chotMist  ralinu  btuausi*  of  thf* 
nature  of  the  douisions  rt-fjiiired  .nid  the  S|j<;ci  f i u i ty  of  thf  items 
listed.  Generally  speakintj,  tite  none  specific  the  items  on  the  check- 
list and  the  longer  the  list,  the  higher  the  reliability.  A general 
nf 'ng  category  is  virtually  worthless. 


EXAMPLES 


“Follows  pre-flight  safely  procedure,"  is  too 
gcfie ra  1 ; but  "makes  the  visual  inspection  of 
aircraft,"  "uses  pre-flight  checklist,"  and 
"starts  engine  after  Starting  signal"  all  provide 
a much  better  opportunity  tc  make  reliable 
ratings  of  perfonaance . 


2^9_. 2.^  Rating  Scales 

1.  iluncrical  scales.  A numerical  scale  divides  performance  into 
a fixed  number  of  points.  The  number  of  points  on  the  scale  depends 
primarily  on  the  abilicy  of  observers  to  differentiate,  Most  people 
are  able  to  make  at  least  five  differentiations;  but  few  trained 
observers  can  reliably  make  more  than  nine  differentiations.  As  a 
re'^ult,  most  numerical  scales  contain  five  to  nine  points, 

2.  Description  scales.  The  description  scale  uses  phrases  to 
indicate  levels  of  abilitv.  The  example  in  Figure  1.23  is  a descriptive 
scale  for  rating  pilot  landing,  with  five  levels  of  ability  described. 
The  degrees  of  performance  can  be  varied  to  suit  the  occasion. 
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INSTRUCTIONS;  Place  a check  mart  In  the  scale  above 
the  wo(d  that  most  accurately  describes  the  pilot 
being  rated. 


1. 

1 ' 

1 

ACCEPTABLE 

FalR  GOOD  EXCELLENT 

SW'ERIOR 

FIGURE  1.23:  Exa.iple  of  Descriptive  Scale  for  Rating  Pilot  Take-Off 

For  example,  suppose  an  cperatiOiic  officer  wants  to  evaluate  the 
flying  ability  of  his  pilots.  He  feels  that  all  his  pilots  saM..fy 
performance  requi  reme.its , but  he  wants  to  knew  to  what  degree  rach  is 
better  than  satisfactory.  By  using  a descriptive  scale,  tho  operations 
officer  gives  his  observers  a frame  of  reference.  Here  the  lowest 
rating  possiule  is  labeled  "acceptable." 

The  major  disadvantage  In  using  descriptive  scales  is  a semantic 
one.  An  "excellent  pilot"  does  not  mean  the  same  thing  to  all  observers. 
Another  disadvantage  is  that  it  is  hard  to  select  phrases  which  describe 
deg'ees  of  performance  that  are  equally  spaced.  When  the  scale  shwn  in 
the  example  is  used,  most  people  feel  that  there  is  less  distance  between 
"excellent"  and  "superior,"  than  between  "fair"  and  "good." 

3.  Graphic  scales.  The  graphic  scale  is  a coml.'ination  of  numerical 
and  descriptive  scales.  Besides  a numerical  scale,  various  adjectives 
or  phrases  are  set  below  a continuous  hori.ontal  line.  (The  line  re- 
presents (.he  range  of  tho  ability  or  trait  being  measured.)  In  using 
the  graphic  scale,  the  obs^^rver  must  consider  not  only  the  numeHcal 
rango  of  the  scale  but  the  phrases  that  describe  the  various  positions 


on  the  scale. 
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Tliret  typir.il  forn:',  of  the  ijrdphii  scjlo  are  r.liowi  in  f inuro 
In  txdtrple  A,  lilt*  ot)‘»crvL>r  ii  given  instrui  tioni  for  judging  the  t*dit 
of  " ir  d'j-j try . " He  i'j  told  to  mark  the  scale  after  considering  "etieriiy 
and  application  to  duties,  day  in  atid  day  out.”  These  irelructions 
help  reduce  errors  and  improve  oh jec  t i vi  ty  and  rel  i ub  i 1 i ty , Ttiey  also 
<-nc(Hirage  i.bsc-rver,  to  coii'.  ider  tlie  Sii'ije  thin<|s  about  eacfi  pi  r'joe 


riGURE  1.24:  example  of  Typical  Fon.i,  of  a Graphic  .Scale 

Example  H shov/5  a rjvepiiic  scale  in  which  .ertaio  types  of  behavior 
are  described  for  each  point  on  the  scale  With  most  scales,  f'e 
observer  must  not  only  observe,  he  luust  also  evaluate  his  observation 
to  fnri.i  a rating.  People  can  observe  more  accurately  tlian  they  can 
evaluate  whe'-  they  have  observed.  Whenever  ratings  can  be  based  on 
observations  alone,  reliability  is  greatly  improved.  I.i  Example  D 
(Figure  1.241,  ttie  observer  is  required  only  to  record,  not  evaluate, 
the  actions  of  the  person  being  rated.  Hence,  t.his  type  of  graphic 
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iCale  incorporates  nijch  i'’’jectivi  ty . In  preparing  this  type  of  scale, 
make  sure  that  the  behav.or  described  for  each  point  is  actually  an 
inproverent  0"er  the  print  just  below  it,  and  distances  between  the  points 
should  appear  to  the  observe.'  to  be  about  equal. 

The  scale  in  CxainpTe  C is  similar  to  that  in  0,  except  descriptive 
phrases  are  not  provided  for  all  points.  Mary  tin'es  observers  feel 
that  the  rating  should  fall  somewhere  between  two  points,  such  a raung 
is  possible  with  this  form  cf  the  graphic  scale.  The  fuller  descrip- 
tions o:  Ixample  C increase  tlie  likelihood  that  observed  behavior  can 
be  pinpointed  on  the  scale.  Generally,  the  more  detailed  descriptions 
should  contribuce  to  better  rating  results. 

2.9 .2 ,5 Es  tab  I i ijK|_  cut-off  scores 

Many  tests  are  designed  to  assess  proficiency  on  a given  task, 
i Since  it  is  often  iiiiprartica I to  insist  on  perfect  test  scores,  it  may 

DC  necessary  to  decide  upon  a cut-off  point  (a  score  below  which  is 

I 

considered  failing  or  "no-go").  The  more  complex  the  skills  assessed 

I by  the  t°st  and  the  more  varied  the  type  of  performance  or  product, 

} 

■^he  greater  is  the  danger  of  misclassification  (designating  a "no-go" 

h- 

as  a "go,"  or  vice  ver:.,a). 

I' 

|1- 

T There  are  no  fixed  rules  or  formulas  for  establishing  the  cut-off 

r point,  but  a number  of  factors  can  be  considered; 

I 1.  Inniediate  manpower  needs.  If  manpower  needs  are  very  high, 

t 

!<  it  may  be  necessary  to  lower  cut-off  levels  especially  if 

in  errors  are  less  critical  than  no  performance  at  all. 

['  2.  Upper  feasible  score  for  an  established  "go."  A target 

H may  be  so  placed  that  even  the  best  marksman  may  score  only 

H 

i'  I 

it 

r 1 


:’L)i 

ro  percent  hit'-.  If  d 70  percent  cut-off  i'.  Get  here,  no 
one  will  pdGS  dl  dll. 

3.  Consequence',  of  iiucleiiurile  perfornance,  or  task  delay 

lulerancu.  The-  qroijer  the  risk  of  GubsLu'itial  danidge  co 
pe  sons  or  cro|)erty,  the  higher  the  cut-off  score  should 
be. 

Lstjbl  ishiiiij  (ut-nff  points  is  a Coinple.''  iiialter,  atij  decisions 
'■liuuld  be  rearhed  on  ttiis  matter  only  after  careful  conoi  der.j  t ion  of 
tlie  ijenei'dl  acrjpLable  pei  .'uniiaiice  tandards  f(i"  tlu-  f.ask(s)  and  the 
corsc-quences . A good  guideline  is  that  if  tlie  consequence';  of  passimj 
one  i ncoirDeten t man  are  severe,  the  cut-off  point  should  be  set  i’igh. 

In  ge-cral,  '.  ut-off-s  arc  useful  when. 

1.  Absolute  iiiastcry  of  the  cask  is  not  expected  but  a suitable 
level  of  performance  can  be  specified. 

2.  Absolute  mastery  is  possible  but  facto. s other  than  com- 
petence affect  the  score  ^such  as  careless  errors,  nieasurement 
Pi  rors  , etc. ) . 

.2.6  Measurement  kr'~ors 

Per-fonnance  measures  must  lead  to  decision;  that  are  consistent  and 
unbiased,  Consistency  implies  that  decisions  made  about  an  individual's 
ability  to  do  his  job  vnll  not  vary  over  a period  o-'"  time  (assuming  that 
the  individual  remains  the  some)  and  that  different  judges  using  the 
same  performance  measure  will  make  the  same  decisions  in  any  given  testing 
situation.  An  unbia.sed  performance  measure  is  one  that  ensures  that 
decisions  are  based  only  on  the  task  in  question  and  are  not  influenced 
by  other  unexpected  or  unaccountable  factors. 


S(,iiie  of  thf  fjctor'"  l.h'jL  1«mc)  to  inco/r  i'jtijficy  <m<l  bi\ij  jn  ^ 
foniwnrt)  measures  are: 

1.  Ihc  lack  of  clear  StatiUard'i.  for  jiuJoin'i  llic  pat  i.icular 
product  or  proceub 

c.  Poorly  written  test  itemc  aiid/or  tebL.ini  dire'  i. ioriu 
3.  Untrained  judges  wfio  may  be  biased  jr  wlio  do  nut  leidcr'-.t^uiri 
the  pertnniiaiice  measure 
'1.  The  testing  .nvironment 

5.  .'lal functions  of  sperial  tools  or  equipment  used  in  tin-  lose 

6.  Individual  day-to  day  ilift'erences  in  perforinanco 


Rating  errors  can  be  classified  into  three  broad  groups; 

1.  Errors  of  standards 

2.  Errors  of  halo 

3.  Errors  of  Ionic 


1.  Errors  of  standard.  Some  observers  tend  to  rate  performers  too 
high  or  too  low  because  of  differences  in  their  standards.  Standards 
using  physical  iiieasuremen ts --inches  , centimeters,  ounces,  grarns--are 
fixed  values.  However,  standards  involving  Judgment  and  a'ts tract  com- 
parison may  be  as  many  and  varied  as  the  observers  themselves. 


EXAMPLE 


Fried  eggs  are  overcooked  if  there  is  a noticeable 
"lacing  or  bubbling,"  around  the  perimeter,  which 
is  a dar!  er  color  than  the  remainder  of  the  egg 
whi te. 

Based  on  this  criteria,  two  observers  migtit  have  c 
great  deal  of  difficulty  agreeing  on  whether  a 
particular  egg  was  overcooked. 
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?..  Error  of  halo.  An  observer  sometimes  allows  his  rating  of 
performance  to  be  influenced  by  his  general  impression  of  the  person, 
Such  an  impression  is  usually  fomied  on  the  basis  of  observations  or 
knowledge  extraneous  to  the  rating.  If  allowed  to  influence  judgment, 
the  imiiressiun  will  result  in  a shift  of  the  rating  called  an  error  of 
halo.  If  the  rater  is  favorably  impressed,  the  shift  is  toward  the  high 
end  of  the  scale.  Halo  error  can  be  either  favorable  or  unfavorable, 
and  it  affects  only  certain  persons  rated.  Error  of  halo  may  be  sus- 
pected in  many  situations;  but  it  can  be  positively  identified  only  when 
many  competent  and  experienced  observers  rate  a number  of  persons  under 
identical  conditions. 

EXAMPLE 

Jones  and  nin^  other  observers  rated  six  persons  on 
teaching  ability.  The  criterion  for  consideration 
for  a promotion  was  a rating  of  5 or  higher  by  all 
ten  raters.  The  ratings  might  have  been  as  illustrated. 


Gwen 
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(Jones'  ratimj  is  indicated  by  0,  other  ra.,ers  by 
X.)  All  ton  observers  agreed  reasonably  wnll  on 
the  teaching  ability  of  five  (f  the  si,<  persons 
rated.  All  but  Jones  agreed  (n  the  teaching  ability 
of  the  sixth  U).  For  person  E,  8 of  the  9 judges 
rated  him  5 or  above--only  Joi.en  rated  liim  lower. 
Appamifly.  Jnnes  allowed  som  • unfavoi  uble 
impression  reijaiJiny  L to  influence  his  rati  tig 
unduly;  he  made  an  error  of  hilo.  If  two  promo- 
tional slots  were  available,  seacher  D world 
clearly  be  considered;  but,  r ■membnring  Jones'  halo 
rating,  there  would  bo  some  difficulty  ’n  deciding 
v;hether  teacher  A or  E should  be  considerod  for  the 
second  slot. 


3.  Error  of  logic.  An  error  of  log  c may  cccur  .vhen  two  or  more 
traits  are  being  rated.  It  is  present  i ' an  observer  tends  trr  give 
similar  ratiiigs  to  traits  which  do  not  nscessarily  ijc.  together.  For 
example,  some  observers  may  think  tha*'  an  industriou;  person  i?  also 
efficient.  Industrious  persons  nay  often  be  efficient,  but  no" 
necessari ly  so. 

"Error  of  logic"  means  that  the  traits  are  related  only  in  the 
mind  of  the  person  making  the  error.  The  relationship  may  not  appear 
to  be  logical  to  someone  else.  As  a matter  of  fact,  the  person  who 
exhibits  an  error  of  this  sort  is  probably  not  really  av are  of  it. 


EXAMPLE 

In  tho  illustration  of  Error  of  Logic  that  follows, 
six  observers  (A,  B,  C,  D,  E,  and  F)  rated  a certain 
person  or,  four  traits  (industry,  promptness,  effi- 
ciency, and  courtesy)  on  a scale  of  1 to  S.  In 
three  of  the  traits,  the  six  observers  agree  reason- 
ably well,  however,  E gave  a much  high(;r  rating  on 
efficiency  than  did  the  other  observers.  And  L 
assigned  the  same  rating  to  both  efficiency  and 
industry.  It  appears  that  E thinks  industry  and 
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efficiency  are  much  the  sanie--an  error  of  logic. 
There  may  be  many  reasons  for  this  error;  E may 
not  h jve  observed  the  performe*''s  efficiency 
enough,  or  he  may  not  distingu  sh  oetween  efficiency 
and  in  iustry.  In  any  event,  in  rating  efficiency, 

E and  the  oJter  observers  have  not  rateJ  the  same 
thing.  In  effect,  E rated  industry  twice. 
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2.10  Validate  and  Revise 


T 


A validated  JPM  is  one  that  has  been 
tested  and  found  to  have  high  predictive 
validity  or,  where  constraints  preclude 
testing,  has  been  verified  as  having 
high  fidelity.  Many  JPMs  can  be 
validated  on  the  job;  e.g.,  mechanics' 
tasks,  cooks'  tasks,  pilots'  tasks. 

These  joos  are  performed  regularly  under 
a broad  spectrum  of  real-world  condition;. 

In  such  cases,  validation  is  similar  to  ,ioh  analysis.  The  validator 
observes  the  performer  and  thereby  checks  his  checklist  or  measur'e. 

The  number  of  incumbents  needed  for  validation  is  very  small  for  unitary 
tasks,  higher  for  multiple  tasks. 


1 
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Thef'e  arc  also  jobs  that  are  performed  rarely  or  only  in  r.onfcat 
where  validation  may  be  hazardous  both  to  the  job  performer  and  the 
validator.  !n  these  cases,  .iPMs  are  "verified"  rather  than  validated. 
Experienced  perfoniters  should  add  any  missing  steps  O"  conditions,  and 
delete  any  supirfluous  ones,  and  verify  the  standards. 

A ti.rd  type  of  validation  is  tor  new  job  tasks:  ones  that  have 

never  been  performed,  like  many  space  mission  or  new  weapons  tasks. 

This  requires  a coittti nation  of  validation  of  the  parts  that  are  similar 
to  parts  of  tasks  that  have  been  performed  before,  and  verification 
with  engineers  and  manufacturers  of  ha>^dwdre.  rh,.se  should  be  consid- 
ered tentative  and  subject  to  revision  when  the  job  is  performed. 

2.10,1  Prepare  for  tiie  Tryn'it 
follow  the  rules  belnw. 

1,  Conduct  the  'Iraft  tryoet: 

- Draft  gene'ai  instmetions  for  the  JPM. 

- Ensure;  through  use  of  SMCs  and  job  incumbents,  that  the 
items  are  congruent  with  the  corresponding  job  tasks. 

- Complete  all  resource  arrangements  for  giving  the  draft 
JP'^. 

- Train  examiners  and  scorers.  At  least  two  (preferably 
three)  scorers  should  be  used. 

- Select  examinees.  Select  several  who  are  typical  of 
the  incumbents  in  the  job. 

2.  Prepare  fonns  for  recording  the  information  discussed  in 


item  3. 
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3.  Select  observers.  Observers  will  watch  the  administration 
of  the  JPM  and  record  information  that  can  be  used  to  correct 
deficiencies  in  the  items  or  the  assessment  procedures 
themselves.  (They  may  be  used  as  scorers  as  well  as 
observers  to  test  reliability  of  the  laters.) 

2. 10. 2 Conduct  the  Tryout 

As  a rule,  conduct  the  tryout  as  if  it  were  "for  real"  except  for 
the  following  procedure.  Conduct  the  tryout  in  stops.  Measure  five  job 
holders  and  revise  the  JPM  to  correct  difficulties  found,  Then,  measure 
the  next  ■‘ive  job  holders;  they  will  be  a check  on  the  success  of  the 
revisions.  This  procedure  may  uncover  further  difficulties,  and  the 
success  (or  lack  of  success)  of  your  revisions  will  be  deiiwnstrated . 
Continue  the  process  of  measuring  and  revision  until  all  dcf’cicncicr. 
are  corrected. 

Following  are  some  guidelines  for  obtaining  information  concerning 
r“obleirs  with  the  testing  situat-on  itself. 

1.  To  see  if  genera!  and  specific  instructions  to  the  examinee 
are  clearly  understood,  ask  the  trainee  to  repeat  them  in 
his  own  words,  Note  any  significant  deviations, 

2.  Record  any  questions  asked  by  the  examinee.  From  these, 
written  instructions  can  be  prepared  to  answer  frequently 
asked  questions. 

3.  Record  any  shortage  of  supplies  or  breakdown  of  equipment. 

4.  Note  any  ways  in  which  the  layout  of  equipment  can  be 
improved  without  impairing  the  validity  of  the  performance 


measure, 
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5.  Note  any  accidental  injury  to  the  examinee  or  damage  to 
equipment. 

6.  Note  ttie  time  required  and  any  problems  experienced  in 
re-establishing  a test  station  for  the  next  examinee. 

7.  If  the  JPM  is  given  in  a series  ot  stations,  observe  any 
problems  experienced  in  maintaining  a smooth  flow  of 
examinees  from  test  station  to  test  station  (i.e  , work- 
bench to  paint  booth). 

8.  Note  any  testing  conditions  which  may  invalidate  the  results. 

9.  When  examinees  make  errors,  question  ttieni.  Note  if  their 
wrung  answers  indicate  a misunderstanding  of  the  item. 

10.  Note  any  actions  of  the  examiner  wfiich  niiglit  give  away  the 
correct  answers  or  confuse  the  examinee. 

Report  this  information  in  sufficient  detail  to  provide  a basis  for 
correcting  any  deficiencies. 

The  purpose  of  the  tryout  is  to  make  the  JPM  as  reliable  as  possible 
by  eliminating  .’5  many  sources  of  unreliability  as  possible.  It  is  not 
necessary  to  try  out  each  item  on  the  performance  measure  to  the  same 
extent.  As  soon  as  an  item  proves  unsatisfactory  when  given  tu  each  of 
at  least  10  examinees,  it  should  be  replaced  with  a new  item. 

Remember,  the  validator  must  verify  JPM  conditions,  cues,  and  standards 
while  iie  is  validating  the  JPM  task. 

When  tiie  tryout  is  finished,  you  will  have  a corresponding  perfor- 
mance measure  for  each  task  on  the  list  of  tasks  selected  for  instruction. 
Ttiese  ineasures  are  n£t_  the  objectives  of  the  instruction,  they  are  int.ende.l 
as  an  evaluative  device  for  quality  control  of  the  instruction. 
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2.10.J  Revise  I terns  as  Required 

ihf  tryout  will  point  out  any  problems  with  your  JPMs.  What  Is  wrong 
usually  can  be  detentilneW  from  the  inputs  you  .jet  from  the  administrators. 
After  you  correct  the  problems,  you  will  have  to  try  out  the  JPMs  again. 
This  cycle  must  be  repeated  until  all  JPMs  are  validated  or  v-erif1ed. 

3.0  ^ OUTPUTS 

The  outputs  of  this  block  should  co  sist  of: 

3.1  Products 

1.  A validated  or  verified  JPM  for  each  task  selected  for 
training.  For  each  JPM,  this  includes  the  required  test 
performance,  and  the  test  conditions,  cues,  and  standards, 

(See  Fi gure  1,25.) 

2.  Admlnirtrative  Instructions  "or  the  JPMs.  (See  Figure  1.26.) 

3.2  Other  Documentation 

1.  The  rationale  for  your  decisions  where  constraints  have 
necessitated  serious  trade-offs. 

2.  A summary  statement  of  implementation  and  results  ot 
verifi cat  ion/ validation. 
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BLOCK  1.4:  ANALYZE  EXISTING  COURSES 


OVERVIEW 

Considerable  time  and  resources  can  be  saved  if  an  e>ti sting  course 
can  be  found  that  will  meet  the  training  need.  Whether  the  existing 
course  will  meet  the  training  need  depends  on  the  acceptability  of  the 
front  end  analysis  upon  which  the  course  was  based  and  on  the  accept- 
ability of  the  ''alidation  documentation.  The  procedure  's  one  of  review- 
ing the  documentation  of  how  the  course  was  developed  and  validated,  and 
making  a determination  as  to  whether  the  methods  used  are  likely  to  have 
produced  a course  that  will  meet  the  training  needs. 
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ANAI.YZL  tXlSriNG  COURSE 
1.0  Inti  oduct  ion 

’'his  blo(,k  ofU'it  is  the  loqicul  boiji.ininy  point  in  tlie  ISii  process. 
As  was  stated  in  Block  l.J,  the  rca.on  for  placinq  this  block  fourth 
IS  that,  to  understand  ctio  procedures  outlined  in  this  block,  you  must 
have  a thorough  unders tand ing  of  yliuL  IdfOS  place  in  the  first  three 
blocks . 

Hie  ISO  process  is  put  into  motion  by  a management  decision  that 
a training  prograii;  iiiust  be  provided  for  a particular  Defense  Occupa- 
tional Specialty  (oOS).  If  this  is  a new  DOS  (that  is,  no  one  does 
the  job  now),  o-  if  no  training  proyraiii  for  this  DOS  is  now  in  exis- 
tence, begin  in  Block  I.l.  Howevei , if  some  one  does  the  job  now  and 
one  or  more  training  courses  exist,  begin  in  this  block.  Here  you 
will  detennino  if  one  of  the  existing  courses  will  iree:  some  or  all 
of  your  requirements. 

Remeniier  that  a*"  this  point  you  have  not  conducted  a job  analysis, 
selected  tasks  for  training,  or  developed  Job  Performance  Measures 
(JPMs).  You  started  out  by  analyzing  existing  courses  to  see  if  you 
could  avoid  all  or  oart  of  the  time  and  cost  not  only  of  carrying  out 
the  above  steps  but  of  developing  and  validating  the  instructional 
ma  terials. 

One  of  the  main  purposes  of  the  interservice  ISO  program  is  to 
increase  the  cooperative  development  and  use  of  training.  This  block 
specifically  requires  careful  search  for  and  analysis  of  existing  needs 
anu  courses  to  ensure  that  these  purposes  are  met. 
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Except  in  highly  technic?!  fields  and  in  areas  where  hardware  changes 
frequently,  niuch  of  what  will  be  done  using  ISU  will  be  the  revision  and 
improvement  of  ccur'es  that  have  already  been  used  for  some  tire.  It  is 
important  to  be  aw^re  of  these  courses  as  early  in  the  ISO  process  as 
possible  for  three  reasons: 

1.  To  avoid  duplication  of  effort  by  utilizing  existing  courses 
withou.  modifications,  or  by  making  only  minor  revisions. 

Such  courses  may  be  offered  by  another  service  or  another 
branch  of  your  service. 

2.  To  permit  a possible  decision,  for  courses  witn  smal'  annual 
enrollment,  to  utilize  an  existing  less-than-perfect  course 
as  a temporary  exped’ency. 

3.  To  avoid  duplication  of  effort  in  analyzing  job  requirements 
and  in  developing  ins*^ruc*-ional  materials.  If  any  part  of 
this  work  has  already  teen  done  to  your  satisfaction,  you 
will  not  have  to  do  it  again. 

When  analyzing  existing  courses,  your  primary  concern  is  wh  ther  a 
course  will  teach  individuals  to  perform  the  tasks  that  are  rr  ,uirtd  to 
P'^rform  on  the  job.  At  this  point  you  have  no  way  of  knowing  what  these 
tasks  are.  The  first  req  irement,  then,  of  an  existing  course  is  the 
availability  of  the  .job  analysis  data  upon  which  the  course  was  based. 

If  this  job  analysis  data  is  not  available,  there  is  no  practical  way 
to  know  whether  or  noc  the  course  meets  the  requirements,  since  these 
requirements  have  not  been  documented. 
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EXAMP!  E 

If  you  have  been  given  the  assignment  of  providing  an 
adequate  training  program  for  ttecontamination  Specialists, 
examining  the  actual  instructional  malerials  for  an  exist- 
ing course  with  the  saine  title  will  not  permit  you  to  pass 
judgnent  on  whether  it  will  meet  your'Traininq  needs.  Even 
If  you  know  this  existing  course  supposedly  trains  peopi  ■ to 
rerform  certain  listed  tasks,  you  cannot  be  sure  these  ere 
the  tasks  you  wish  to  train.  Before  you  can  .Judge  whether 
the  tasks  covered  in  the  existing  course  are  likely  to  be 
the  same  tasks  you  need  to  train,  you  must  know  how,  when, 
and  where  the  task  list  was  prepared. 


The  above  example  points  out  tiie  need  not  only  for  examination  of 
the  job  analysis  data  but  for  examination  of  the  criteria  by  which  tasks 
were  selected  for  training.  Also,  since  the  terminal  learning  objectives 
for  a course  are  derived  from  the  Job  Performance  Measures  (JPMs),  you 
will  reed  to  analyze  the  JPMs  to  determine  whether  the  existing  course 
is  based  on  measures  that  are  realistic  predictors  of  job  performance. 
These  three  major  steps--job  analysis,  selection  of  tasks  fur  training, 
and  development  of  JPMs--are  usually  referred  to  as  Front  End  Analysis. 
Front  End  Analysis  has  to  have  been  accomplish  d by  acceptable  ISO  pio- 
cedures  before  you  can  pass  judgment  on  whether  the  existing  course  ran 
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be  used.  For  this  reason,  having  at  hand  the  actual  instructional  materials 
foi  an  existing  course  is  not  initially  as  important  as  having  at  hand  the 
documentation  of  how  the  Front  End  Analysis  was  accomplished. 

In  addition  to  the  documentation  ol  the  Front  End  Analysis,  you  will 
need  to  know  hew  the  existing  course  was  validated;  that  is,  how  it  was 
determined  that  students  who  take  the  course  actually  learn  what  they  are 
supposed  to  leam.  This  validation  data,  however,  is  not  as  essential  as 
the  Front  End  Afialysis  data  because  it  is  easier  to  vali'.’ite  an  existing 
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course  than  it  is  to  redesign  a course  that  is  based  on  an  unacceptable 
Front  End  Analysis. 

For  the  cases  in  which  Front  End  Analysis  shows  that  the  procedure 
used  in  constructing  the  course  produce  basically  the  same  results  es 
would  the  ISU  procedures  (described  in  Blocks  I.l,  1,2,  and  1.3),  you 
can  accept  that  the  selected  tasks  correspond  to  those  you  consider 
important.  And  if  the  validation  documentation  shows  that  individuals 
taking  the  course  '^o,  in  fact,  learn  what  they  are  supposed  to  learn, 
you  can  accept  thut  basically  the  course  is  acceptable. 

You  may  question  the  idea  of  discarding  a course  just  because  the 
Front  End  Analysis  is  non-e.  istant  or  is  unacceptable.  Jf  some  of  the 
course  materials  sfll  could  be  useful,  you  may  be  correct.  Later  in 
the  model,  in  Blcck  III. 3;  REVIEW/SELECT  EXISTING  MATERIAL‘S,  all  or 
portions  of  an  existing  course  may  be  selected.  However,  before  you 
can  Jetenniiie  to  train,  you  must  determine  what  to  train.  In  this 
block,  your  primary  concern  should  he  the  basis  upon  which  the  course 
was  built  rather  than  the  actual  course  content, 

It  would  be  Unrealistic  to  expect  an  existing  course  co  serve  per- 
fectly. For  instance,  language  barriers  created  by  specialized  termi- 
nology will  make  even  your  attempt  to  locate  and  interpret  the  Front  End 
Analysis  data  for  an  existing  course  ore  difficult.  Each  of  the  services 
has  developed  a functional  language  or  its  own  whic  , can  ha  most  con- 
fusing to  outsir'  -s . Is  it  a "deck"  o’-  a "floor,"  a "head"  or  a "latrine?" 
Even  usage  of  similar  terms  varies  greatly,  ■'"he  Army's  TRADOC  Peg.  350-100-1 
refers  to  the  "Systems  Engir,eering  of  Training,"  wh^le  the  Navy's  CNET 
Instr. 1550.0  refers  to  the  ''Instrurtional  .Systeins  Development  of  Training." 

Ue  would  ask  the  Air  Force  if  a course  had  been  developed  accni'ding  to  ISO 
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or  by  the  procedures  in  AFP  bO-ZB,  but  we  wouid  ask  the  Artny  if  the  course 
had  been  systems  engineered.  Rven  if  you  find  a course  acceptable,  you 
anjst  expect  to  make  minor  changes  to  translate  specialized  language  to 
Fit  your  service  and  coamanJ. 

The  output  of  this  block  will  include  your  judgment  of: 

1.  Whether  the  Front  End  Analysis  and  validation  of  existing 
courses  is  acceptable  to  your  command. 

2.  If  part  of  the  Front  End  Analysis  or  the  course  validation 
is  not  acceptable,  what  part  is  acceptable. 

3.  Whether  cay  part  of  the  work  that  hjs  already  been  done  is 
potentially  usable  and,  if  so,  which  parf . 

The  steps  in  analyzing  existing  courses  are  shown  in  Figure  1,27, 
the  fold-cut  puge  at  the  end  of  this  block. 

2.0  Procedure 

The  first  three  steps  in  the  ISO  process  require  much  effort  to  collect 
and  analyze  documents,  prepare  job  descriptions,  and  make  a variety  of 
highly  important  decisions.  If  these  three  steps  are  done  well,  training 
provided  will  coincide  with  the  tasks  performed  on  the  job,  If  they  are 
not  done  well,  unnecessary  training  or  lack  of  training  for  importart  job 
requirements  will  >"esult. 

In  this  block,  you  will  analyze  the  documentation  of  the  basis  for 
development  of  existing  courses  to  determine  if  a course  trains  what  needs 
to  be  trained.  There  are  two  kinds  of  courses: 

1,  Those  that  have  been  pro,oerly  developed  by  ISO  (that  is. 
properly  systerns  engineered),  and 


2.  Those  that  have  not. 
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Properly  pr'epared  ISD  courses  will  have  available  for  analysis  the 
documentation  of  how  the  cojroes  wei^e  developed.  They  will  have  been 
developed  only  after  proper  Front  End  Analysis.  They  will  be  based  on 
competent  job  analyses,  will  have  training  priorities  clearly  specified, 
and  will  have  realistic  performance  measures  developed.  No  course  can  be 
said  to  be  properly  developed  unless  these  three  conditions  are  met, 
regardless  of  the  sophistication  of  the  training  equipment  or  methods. 

If  there  are  existing  courses.  In  any  of  the  services,  that  have  been 
developed  by  ISD,  or  if  there  are  even  parts  of  these  courses  that  can  be 
used,  much  time  and  money  can  be  saved.  In  the  ideal  situation,  you  can 
use  an  existing  course  with  only  minor  if  any  changes.  And  even  as  a mini- 
mimi,  1m(iortant  parts  of  the  course  can  be  acquired  for  use,  thus  saving 
the  cost  of  duplicating  the  training  materials  and  procedures.  Further, 
meetings  can  sometimes  be  held  with  directors  and  instructors  of  the 
existing  courses  to  gain  the  benefits  of  their  training  and  experience. 

A considerable  amount  of  judgment  will  be  required  in  making  decisions 
about  the  appropriateness  of  materials  and  courses  developed  external  to 
the  conmand  in  which  they  are  needed.  But  also  guard  against  the  natural 
tendency  among  professionals  to  as;;ume  that  work  elsewhere  has  not  been 
done  to  the  high  standards  established  locally.  This  tendency  is  fre- 
quently refer'-ed  to  as  the  NIH  (noc  invented  here)  attitude  which  means 
that  unless  m did  it,  it  cannjt  be  good. 

But  even  locally  there  is  much  training  that  has  been  developed  without 
having  an  adequate  listing  of  the  tasks  most  important  for  training.  And 
since  training  sometimes  e-x-p-a-n-d-s  to  fill  the  time  available  because 
of  block  scheduling,  there  is  often  much  out-of-date  and  nice-to-know 
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coni'^nt  1n  training  courses.  Also,  many  training  courses  arc  developed 
without  being  preceded  by  a highly  refined  and  approved  procedure  for 
selecting  tasks  for  training. 

Remember,  you  should  not  reject  good  training  just  because  it  was 
developed  elsewhere,  and  you  should  not  accept  available  training  just 
because  it  Is  available. 

2..1  Secure  Existing  Courses  and  Their  Development  Documentation 

Appendix  B of  Block  I.l  lists 
sources  of  training  courses  and 
Instructional  materials,  and 
sourses  of  job  analysis  data. 

In  addition  to  these  directories 
and  manuals,  each  service  has  a 
central  training  management 
command  that  is  aware  of  all 
existing  courses  and  new  courses 
being  developed.  These  sourses  should  be  consulted,  according  to  the 
procedures  established  by  your  cotimand  for  that  purpose,  in  order  to 
determine  if  c.nurses  are  planned  or  already  exist  which  might  satisfy 
your  needs . 

Remember,  however,  that  the  actual  course  materials  are  not  the  primary 
concern  at  this  point.  The  detailed  documentation  of  how  the  course  was 
developed  is  often  much  more  difficult  to  obtain.  You  may  have  to  trace 
the  course  back  to  the  individual  or  group  responsible  for  the  original 
development.  Even  if  the  course  develooment  documentation  has  not  been 
printed,  it  may  be  available  in  the  workbooks  and  notes  of  those  who 
developed  i t. 
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2.2  Analyze  Job  Analysis  Documentation 
If  you  determine  that  the  existing 
course  was  not  based  on  a job  analysis 
or  that  job  analysis  documentation  1-. 
not  available  you  will  have  to  go  back 
to  Block  I.l  and  analyze  the  job.  If 
the  course  ha^  a documented  job  analysis, 
you  must  determine  If  it  is  acceptable. 

Some  criteria  for  making  this  determi- 
nation are  as  follows; 

1.  If  the  analysis  was  not  done  within  the  last  five  years, 

the  data  may  be  obsolete.  However,  the  nature  of  the  job 

is  a factor  here,  seme  jobs  change  very  little  over  time. 

2.  If  there  have  been  substantial  equipment,  doctrine,  manpower, 
or  personnel  system  deletions  or  additions  since  the  analysis 
was  done,  you  probably  will  have  to  do  it  over.  But,  at  least, 
what  is  already  done  can  be  a starting  point  for  the  new  job 
analysis , 

3.  The  sources  of  the  job  data  is  critical.  It  is  possible,  for 
example,  that  the  so-called  job  analysis  was  conducted  by 
talking  to  people  who  once  held  the  job,  or  by  copying  from 
course  outlines  and  lesson  plans.  This,  of  course,  1s  not  an 
acceptable  job  analysis. 

4.  If  the  analysis  was  done  according  to  procedures  in  Block  I.l 

or  according  to  procedures  similar  to  those,  you  can  have  con- 

siderable confidence  1n  the  accuracy  of  the  analysis. 
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5.  Even  if  the  job  analysis  was  expertly  done,  it  still  might 
not  be  acceptable.  It  is  essential  that  the  conditions  and 
requirements  under  which  the  analysis  was  conducted  De  close 
enough  to  your  situation  to  allow  you  to  generalize  from  one 
to  the  other. 

EX/WLE 

If  the  job  analysis  for  a specialized  equipment  repainnan 
was  co.iducted  on  aircraft  carriers  in  the  South  Pacific, 
and  if  the  job  with  which  you  are  concerned  is  repairing 
the  same  equiptnent,  but  on  aircraft  in  Greenland,  you  may 
not  be  able  to  generalize  from  one  situation  to  the  other. 

f).  If  the  job  analysis  data  are  difficult  to  locate,  and  if 
tiife  data  are  in  only  a semi-official  fomii  you  should 
place  less  confidence  in  the  data.  Usually,  when  a job 
analysis  has  been  done  properly,  it  will  be  documented 
and  the  documentation  will  be  readily  available. 

Based  on  the  above  criteria,  you  should  either: 

1.  Reject  the  existing  job  analysis,  and  go  to  Block  I.l  and 
start  at  the  beginning.  However,  be  generous  at  this  point; 
you  should  completely  reject  the  e>isting  analysis  only  if 
it  is  clearly  unacceptable. 

2.  Tentatively  accept  the  analysis.  In  this  case,  verify  the 
task  list,  preferably  by  having  it  reviewed  by  a jury  of 
experts.  Based  on  this  expert  review,  either  accept  the 
analysis  and  move  on  to  Section  2.3  of  this  block,  or  reject 
the  analysis  and  go  back  to  Block  1,1  and  conduct  a new  job 
analysi s . 
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2.3  Analyze  Method  Used  to  Select  Tasks  for  Training 
Once  you  have  detenni.net.  that  the 
job  analysis  for  the  existing  course 
Is  acceptable,  you  ar^  ready  to 
deLemlne  wtwUier  the  tasks  selected 
for  training  were  selected  according  to 
the  needs  and  priorities  of  your  command. 

Since  those  who  developed  tne  existing 
course  apparently  did  an  acceptable  job 
analysis--! f not,  you  would  not  have 
accepted  their  work,  and  you  now  would 
be  working  in  Block  I .1  instead  of  in 
this  section  of  this  b]ock--the  chancer,  ar.?  very  jood  that  they  also  did 
a good  job  of  selecting  tasks  for  training.  Some  guidelines  for  judging 
the  acceptaollity  of  tasks  selected  for  training  are: 

1.  Did  the  developers  of  the  existing  course  base  their  selection 

of  tasks  for  training  on  basically  the  sart.'e  criteria  that  are 

important  to  your  cotmand?  A mmiber  of  these  criteria  were 
discussed  in  Block  1.2.  It  is  not  essential  that  the  criteria 
used  match  exactly  those  you  would  have  used.  However,  they 
should  and  probably  will  be  reasonably  close.  If  the  course 
developers  failed  to  use  some  criterion  that  you  think  is 
particularly  important,  you  can  survey  a small  group  of  perhaps 
15-30  individuals  who  are  familiar  with  the  job,  and  have  them 

rate  the  tasks  according  to  this  criterion.  You  may  find  that 

including  this  criterion  would  have  made  very  little  difference 
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in  which  tasks  were  selected  for  tralrn'iiig.  If  it  appears 
to  make  a major  difference,  you  may  have  to  , 'eject  the 
existing  course  and  go  back  to  Block  !-2  and  select  task^ 
for  training. 

Z.  Was  the  data  upon  which  the  selection  cf  tasks  was  ba^ed 
obtaioid  from  basically  the  sane  gecgraphical  locations, 
skill  levels,  etc.,  that  you  would  have  used?  If  you  think 
inputs  from  certain  critical  groups  were  not  included,  you 
can  take  a small  sample  survey  of  those  groups  and  sec  if 
the  additional  data  makes  a significant  difference.  Again, 
it  it  does,  you  may  have  to  reject  the  existing  course  and 
rcselect  > tasxs  for  training. 

3.  Did  those  who  developed  the  existing  coutsi,'  base  task  salcction 
on  basically  the  same  time,  money,  and  other  resource  con- 
straints that  exist  in  your  conmand?  If  not,  they  might  have 
included  tasks  that  you  cannot  artorc*  *-n  'rain,  or  they  might 
have  skipped  casks  that  must  te  trained.  You  will  need  niatugc- 
ment  inputs  to  decide  whether  to  train  fewer  tasks  or  more  tasks 
than  are  included  in  the  existing  course. 

If  you  decide  to  train  more  tasks,  you  still  may  he  able  to  use  the 
existing  course.  It  minnt  bo  practical  and  considerably  less  expensive 
to  develop  traininq  ror  the  added  tasks  and  to  use  this  new  training  along 
with  the  existing  course. 

I’"'  you  cannot  affort  to  train  all  the  tasks  included  in  the  existing 
course,  you  may  be  able  to  delete  the  unwanted  tasks  from  the  course.  It 
usually  is  considerably  les;,  costly  to  aelete  materials  from  a good  course 
than  start  at  the  beginning  and  develop  a new  course. 
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2.4  Analyze  Job  Perfonnafice  ^asures 
Once  you  have  obta1r«d  concurrence 
:n  your  ccmnand  on  the  tasks  '‘•alerted 
for  training,  then  find  out  If  adequate 
joh  performance  measures  (,iPMs)  exist  for 
tha  selected  tasks.  Block  1.3  gave 
detailed  infomation  on  how  to  (^velop 
good  J°Ms.  If  you  apply  this  iniorma- 
tiun,  you  should  be  eble  to  recognize 
good  dPfte-  developed  by  others.  Careful 
rovi^  of  a small  sample  of  the  JPMs 
usually  will  give  an  idea  whether  the 
JPMs  ore  totally  unacceptable  or 
probably  acceptable. 
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EXAMPLES 


1.  If  the  task  1s  “adjust  carburetor"  and  the  JPH  is 
“tell  why  well-adjusted  carburetors  are  important," 
you  know  you  have  a lot  of  work  to  do.  The  match 
between  “adjust"  and  “tell  why"  is  too  poor  for 
the  latter  to  be  an  acceptable  Ji’M. 

2.  If  the  task  is  "destroy  bridge,"  and  the  JPM  is 
"gi'ven  approp*'iate  tools  and  eouipment,  destroy 
bridge,  in  the  face  of  enerqy  fire,  in  1 hour  or 
less,"  you  can  reject  the  existing  course  and  go 
to  Block  1.3  and  start  developing  JPMs.  While  the 
above  is  a very  good  match,  the  JPM  would  be 
impossible  to  a(tnin1ster. 


If  the  JPMs  appear  reasonably  well-developed,  you  will  want  to  review 
all  of  them.  You  may  be  able  to  nakc  minor  changes  in  some  of  the  JPMs 
without  seriously  affecting  tii?  course.  You  may  be  able  to  use  only  the 
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part  of  the  course  that  Is  based  on  acceptable  JPMs.  At  best,  you  will 
have  acceptable  JPMs  and  probably  an  acceptable  course.  At  the  worst, 
use  the  existing  JPMs  as  a starting  point  for  developing  new  oi«s. 

2,5  Analyze  Validation  Doctanentation 

If  you  accept  the  JPMs  for  the  existing 
course,  this  means  you  are  in  basic  agree- 
ficnt  that  the  course  was  designed  to  teach 
what  you  consider  to  bo  important.  The 
only  remaining  qi»stion  is  whether  thn 
exiscing  course  does,  in  fact,  teach  what 
it  was  designed  to  teach.  The  chances  are 
good  that,  since  ycu  hove  already  determined 
that  the  course  was  based  on  an  acceptable 
Front  End  Analysis,  you  also  will  find  the 
course  has  been  properly  validated.  Course 
validation  is  discussed  in  detail  in  Block  IH.5. 

If  the  course  has  been  properly  validated,  you  will  need  to  know  some- 
thing of  the  entry  behaviors  of  students  used  to  validate  the  course.  If 
there  is  not  reasonable  ce?tainty  that  their  entry  behaviors  are  like  the 
entry  behaviors  of  your  students,  you  will  have  to  revalidate  the  course 
for  your  students.  Entry  behavior  is  discussed  in  detail  in  Block  II. 3. 

If  the  course  has  not  been  properly  validated,  or  if  the  data  are  not 
available  to  make  that  decision,  you  will  need  to  go  to  Block  III. 5 and 
go  through  the  procedures  necessary  to  determine  if  the  course  does  what 
it  was  designed  to  do. 
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2,6  Hake  RequI red  Revisions 


Now  that  yo"  have  a course  based  on 
an  dccefjtable  Front  End  Analysis,  and 
now  that  you  knov/  It  teaches  what  It 
was  designed  to  teach,  your  ctevelopment 
effort  is  almost  complete.  As  was 
mentioned  earlier  in  this  block,  differ- 
ent services  often  use  di f fercnt  woros 
to  mean  the  same  thing--or  the  same  word  to 
mean  different  things.  You  probably  wil" 
have  to  do  some  minor  revision  to  make  the 


course  siore  understandable  to  your  students. 
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If  you  revalidated  the  course,  so.ne  required  changes  may  have  been  indicated 
In  the  valldacion  process.  You  may  have  to  change  some  of  the  examples  used 
in  the  course  to  make  the  course  more  specific  to  your  conmand.  All  of  this 
should  be  a relatively  minor  effort  compared  to  the  considerable  savings 
resulting  from  your  using  an  acceptable  existing  course. 

3.0  Outputs 

The  outputs  of  this  block  shcrid  consist  of: 

3.1  Products 

1.  Definition  of  the  jcb.  (See  page  86  in  Block  J 1 for  m example.) 

2.  If  a suitable  course  is  found,  the  coiiplete  course  (see  page  BG 
for  an  example)  as  it  appears  after  any  '•evisions. 

3.  If  a suitable  course  is  not  found,  any  portions  of  the  analyzed 
courses  that  are  potentially  useful  in  designing  a new  course. 
iSee  page  228  for  an  example.) 
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No  suitable  course  was  located  ♦'or  the  job  of  OH-58  Helicopl.^r 
RepaltTiian.  The  course  review  was  not  unproductive,  however. 

A number  of  potentially  useful  instructional  materials  were 
identified  and  are  listed  below.  These  will  be  reviewed 
thoroughly  in  Clock  111.3;  ANALYZE  EXISTING  COURSES. 

Potentially  useful  existing  instructio.nal  materials  for  the 
Job  of  011-58  Helicoi  ter  Repaiwati. 

1.  Cue  iO-tninute  35  mm  sHd»  presentation  deii»nstratiiKj  installation 
of  the  tail  rotor  gear  box. 

2,  One  set  of  transpa.'enc ies  demonstrating  the  maintenance 
operational  check  of  the  main  transmission  oil  system. 

3 Student  handout  dcscribitig  procedures  for  troubleshooting  the 
main  transmission  oil  system. 

4.  Lecture  script  entitled  "Coinponents  and  Troubleshooting  Procodurer, 
e.xplainiiKj  the  rel atiofiships  between  the  romponents  of  titc  ir.ain 
transmission  oil  system  and  the  procedures  for  troubleshooting  the 
sys  tein, 

5.  Student  outline  describing  the  components  of  the  main  transmission 
oil  system. 

6.  Set  of  schematic  35  mi  slides  demonstrating  procedures  for 
insoecting  the  main  transmission  oil  system  for  external 
evidence  of  damage. 


3.2  Other  Dori imentation 

1.  Statement  of  rationale  for  conducting  analysis  of  existing  courses 

2.  Identifi caMon  of  courses  analyzed. 

3.  Suninary  Statement  of  major  decisions  in  analyzing. 

4.  Sunniary  statement  of  any  revisions  made  to  existing  course, 
and  reasons  for  the  revisions. 


INPUTS 


F IGURE  127:  Flowchart  of  Block  1.4:  ANALYZE  EXISTING  COURSE 
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Best  Available  Copy 


BLOCK  1.5:  SELEQ  INSTRUCTIONAL  SETTING 


OVERVIEM 

To  ensure  that  adequate  training  resources  will  be  available  when 
required  upon  the  completion  of  development  of  training,  an  early 
decision  nnist  be  made  as  to  the  instructional  setting  or  settings  in 
which  the  tasks  will  be  trained.  The  optimum  instructional  setting 
for  a task  is  the  setting  that  prevides  tne  most  effective  and  effi- 
cient training  to  those  who  require  the  training,  at  the  point  in  time 
when  the  training  is  most  needed  by  the  trainees. 
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L0_  UmiODIICTlOH 

An  instructionol  settiny  is  the  vehicle  or  agency  by  or  through  wnich 
1 trainee  who  ’nitially  is  tiot  able  to  pe>"forni  a task  or  part  of  a task 
beroines  proficient  in  the  performance  of  the  task  or  pari  of  a task.  The 
major  iiistructional  settings  t'iscussed  in  this  ijlock  are: 

1.  Job  Performance  Aids  (JPAs) 

2.  Self-Te=>ching  Exportable  Packages  (STEPs) 

3.  Fori'-al  On-the-Joh  Training  (FOJT) 

Installation  Support  Schools  (ISS') 

5,  Resident  Schools  (KS) 

Often,  instruction  is  thought  as  being  limited  to  a school  setting. 
This  is  partly  because  of  a strong  tradition  for  conducting  training  in 
schooiS  even  '.vhen  good  alternatives  are  available.  Some  reasons  why 
instructional  settings  other  thun  the  school  must  be  considered  are: 

1.  Sonic  tasks  cannot  be  adequately  traiivd  in  school. 

2.  There  generally  is  more  of  a requirement  for  training  than 
can  be  mot  with  th"  school's  limited  resources. 

3.  The  aC'.ive  services  have  been  required  to  assume  increasing 
responsibility  for  training  the  Rese>*ves , the  National  Guard, 
and  our  a''iies,  while  at  the  same  time  facing  reduced  budgets 
as  a result  of  government  economy  measures. 

The  major  inputs  to  this  Block  are: 

1.  The  tasks  selected  fur  training  in  Block  1,2,  along  with  the 
data  that  was  collected  to  serve  as  a basis  for  the  selection 
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decisions.  These  items  are  important  because  the  tasks 
selected  for  training  are  Use  ones  for  which  you  will 
now  select  training  settings,  and  because  mud;  of  tl‘e 
data  used  to  select  tasks  for  training  also  will  he 
used  to  select  training  settings. 

2.  The  Job  Performance  Measures  (JPMs)  constructed  in  Block  1.3, 
along  with  the  JPM  conditions,  cues,  standards,  and  procedures. 

The  JPMs  arc  critical  to  this  block  because  they  indicate  the  environ- 
mental, facility,  equipment,  and  personnel  requirements  for  iraining. 

These  also  will  have  a considerable  impact  on  the  choice  of  training 
settings. 

The  decisions  you  will  make  in  this  block  are: 

1.  Wr^  should  be  trained  to  perform  each  task;  that  is,  should 
everyone  in  the  DOS  be  trained  or  only  those  assigned  to 
certain  units. 

EXAMPLC 

Three  tasks  performec  by  Aircraft  Life  Support  Specialists 
might  be: 

1.  Inspect  Very  pistols. 

2.  Construct  arctic  shelters. 

3.  Construct  tropical  -shelters. 

If  most  job  incumbents  inspect  Very  pistols,  everyore  in  the 
DOS  should  be  trained  for  that  task.  However,  most  likely 
only  those  assigned  to  a unit  in  the  arctic  should  be  t.'ained 
to  construct  arctic  shelters,  and  only  those  assigned  to  a 
unit  in  the  tropics  should  be  trained  to  construct  tropical 
she!  ters . 
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2.  should  training  be  provided  for  each  task,  5one  tasks 

have  a high  tecay  rate;  that  is.  If  the  task  is  not  per- 
formed soon  after  training,  the  trained  Individual  can  forget 
how  tr  perform  it. 

EXAMPLE 

If  most  Jet  I ngirie  Mechanics  do  not  perfonn  the  task  of 
"balance  personnel  workload"  until  they  have  been  assigned 
for  four  years,  <t  would  be  wise  not  to  train  the  task 
until  it  is  needee. 

j.  Which  instructional  setting  is  appropriate  for  the  task. 

This  decision  involves  questions  of  training  effectiveness, 
efficiency,  fidelity,  and  cost  as  well  as  the  twe  factors 
just  discussed. 

EXAMPLE 

If  rv)St  submarine  sonar  technicians  must  perform  certain 
tasks  immediately  upon  assignment,  and  if  the  facilities 
required  for  training  these  tfisks  are  available  only  at 
the  Fleet  Sonar  School,  tnese  tasks  should  be  taught  in 
school . 

In  this  block,  you  will  nominate  each  task  for  assignment  to  one  of 
five  instructional  settings.  Definitions  of  these  settings  a»e  as  follows: 
1.  Job  PerfontKince  Aids  (JPAs).  Technically,  Job  Performance 
Aids  (JPAs)  are  not  training,  but  rather  a substitute  for 
training.  A JPA  provides  step-by-step  procedural  guidance 
in  the  performance  of  a task  or  element.  It  can  be  a list. 
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a "flowchart,"  "decuion  tree,"  or  "algorithm"  that  outlines 
the  specifics  and  l^ads  the  user  to  successful  performance  of 
the  task.  A cook's  or  baker's  recipe  book  is  a good  example 
of  a JPA.  Ft  requires  certain  bas-c  skills  that  are  used  in 
a variety  of  situations:  frying,  deep  fat  frying,  baking, 
broiling,  etc.,  are  used  with  different  foods.  Each  is  a 
separate  skill  that  must  be  acquired.  However,  frying  to 
remember  recipes  and  proportions  would  be  a hopeless  waste 
of  time.  Thus,  the  recipe  book  is  a rook's  JPA. 

The  judicious  use  of  JPAs  can  contribute  signi firantly  to  training 
eco/iorny  and  effectiveness,  and  their  use  has  been  responsible  for  important 
job  perfonience  improvements.  Some  tasks  can  he  dune  completely  with  JPAs 
if  those  performing  the  task  have  mastered  the  use  of  the  necessary  tools 
such  as  wrenches,  levers,  hantners,  screw  drivers,  meters,  and  gauges. 

This  does  not  imply  that  they  could  perforin  all  tasks  without  supervision; 
however,  very  ftw  individuals  in  the  military  are  required  to  work  without 
supervision.  Also,  unlike  inforination  that  once  learned  is  quickly  for- 
gotten if  not  used,  JPAs  are  not  subject  to  decay.  While  names,  weights, 
tables,  and  procedures  are  forgotten  more  quickly  than  rules  and  motor 
skills,  JPAs  can  effectively  support  the  job  incumbent's  memory  by  storing 
the  names,  weights,  tables,  and  procedures  in  a convenient  form  near  where 
the  task  is  perforired. 

Decals  attached  to  equipment  represent  a simple  form  of  JPA.  Main- 
tenance charts,  proceo  iral  guides,  and  signs  represent  other  simple  appli- 
cations. However,  those  that  probably  have  the  potential  for  the  highest 
payoff  are  ones  that  contain  decision  trees  or  flowcharts.  These  JPAs 
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can  be  used  in  troubleshooting,  repairing,  and  following  inslru';tiOiS  and 
procedures  that  require  decisions  involvi'g  a number  of  options.  Sterne 
ePAs  are  used  as  a substitute  for  training  when  task  performa'’ci'  ca  i be 
accomplished  that  way.  i'he  more  coirplex  types,  often  called  “r'jl  ly  Pro- 
ccduralized  Job  Perfonnance  Aids"  usually  rely  on  basic  skills  acquired 
by  trainees  ajnd  training  on  the  use  of  the  JPA.  An  example  is  shiovn  in 
Figure  1.28. 

Self-  Teaching  Exportable  Packages  (STtiPs).  The  dint.1ni|uishing 
features  of  sel f- teaching  exportable  packages  are  that  they 
are  designed  to  be  used  without  an  instructor  present,  and 
they  generally  can  be  sent  to  or  used  by  the  student  wherever 
he  is  stationed.  Such  packages  may  include  printtsd  iiiaterlals, 
audio  or  audio/visual  delivery  systems,  relatively  smell  train- 
ing kits  of  *’oo1s  and  items  to  be  asseiitfjled,  repaired,  or 
operated,  and  any  other  conipact,  transportable  items.  Also, 
tl.e  course  may  be  designed  to  make  use  of  facililies  ind 
equipment  known  to  be  available  to  the  students.  Sel f-teachi ng 
exportable  packages  (STEPs)  include  but  are  not  limited  to 
correspondence  courses. 

While  an  instructor  is  not  required  at  the  student's  locatioi  , assis- 
tance often  is  available  by  correspondence  with  the  issuing  agenev,  STEPs 
generally  are  intended  for  irdividual  use  and  can  be  used  by  the  Indi- 
vidual on  his  own  time.  Hov/ever,  STEPs  also  may  be  used  by  two  or  more 
individuals  meeting  together  holding  discussions  and  critinue.s  for  their 


mutual  benefit.  STEPs  generally  include  a testing  program  v..iereby  the 
course  tests  are  either  administered  by  a designated  local  offhial  nr 
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FIGURE  1.28:  Example  of  A Job  Pc.-fonnance  Aid  (JPA) 
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by  roiresponck-'Mce  with  tbn  i'.t-uirifj  aijoncy.  In  order  to  qualify  a',  a 
STLf,  a package  uiust  provide  feedback  to  llio  trainee  no  his  perfonnatnc 
and  must  have  been  developed  by  the  procedures  in  Hlock  II’. 4 or  similar 
procedures . 

3.  lorma'  On-the-Job  Traitnn(j_(J_!)JJ_) . fOJT  is  a planned  training 
program  designed  to  qualify  or  upgrade  people,  through  self- 
study  and  supervised  instruction,  to  perform  in  a given  DOS 
while  actually  working  on  the  jo'  . The  programs  are  noniially 
designed  and  supported  by  proponent  schools.  Iht;  craimne;  Is 
conducted  in  the  actual  work  situation  generally  by  desig- 
r.,  aid  s'lpervisors  who  also  work  in  suppori  of  Mie  unit  mission, 

The  FOJl  supervisor  is  can.'tully  selected  on  the  basis  of  his  havimi 
the  knowledge  and  experience  to  conduct  training  and  administer  >)eb  Per- 
foniiance  Measures.  He  is  ordinarily  tlie  best  qualified  senior  NCO  avail- 
able, He  maintains  the  fCJT  records  and  forms  and  selects,  trains,  and 
counsels  students.  The  FOJT  supervisor  prepares  task  breakdowns  for  each 
trainee,  instructs,  motivates,  and  evaluates  trainees,  FOJT  requires 
coniprehensi ve  planning,  careful  scheduling,  timely  implementation,  capable 
direction,  skillful  application,  and  expert  evaluation.  Therefore,  it 
must  be  used  only  where  the  necessary  manpower  resources  are  available. 

FOJT  generally  is  used  whore  tasks  are  complex  and  can  be  learr>ed 
faster  or  to  a higher  proficiency  level  v/ith  hands-on  experience.  Such 
progrmis  can  be  particularly  effective  for  people  assigned  to  a unit  or 
ship  having  hardware  or  weapon  systems  new  to  them.  Another  major 
advantage  is  that  most  programs  permit  the  trainees  to  nmke  a positive 


corrtributlon  to  the  job  whil"  they  jre  being  trained  to  perfonii  wire 
advanced  ta'ik^ . 

4.  Instal  lation  Support  Schools  (151.) . An  inscHllation  supoort 
school  (ISS)  is  orQdnji"d  and  operated  by  individual  units 
or  ccMTinands  to  meet  local  training  regui renients . While 
such  schuoi'.  may  not  have  the  broad  range  of  training 
resources  usually  available  at  a resid'iPt  school,  they  have 
(he  advantage  of  being  near  the  act'ia)  eguipinent  or  facili- 
iies  used  by  the  local  unit.  Often  this  equipment  and 
f'a-ility  can  be  used  for  training  pji'poses  by  the  installa- 
tion support  school.  These  schools  generally  Ste  responsive 
to  slior t-notic'’  training  needs.  In  addition,  tr’ainees  often 
can  rccoivc  training  oi  the  installaiion  suppor’t  school  while 
at  tlie  same  time  continuing  to  perform  all  or  part  of  thuir 
assigned  duties. 

5.  P.esident  Schools  (K^.  riesident  schools  (RS)  serve  to  meet 
service -wide  training  reauirements.  Such  schools  in  each 
service  are  controlled  by  training  headquarters.  The  schools 
respond  to  active  duty,  reserve,  and  national  guard  training 
requirements  as  well  as  some  federal  government  and  allies 
requirenients.  P sident  schools  generally  develop  their 

own  tr-aininq  nrograms  and  often  develop  courses  for  installa- 
tion support  schools,  FOJT  programs,  correspondence  courses, 
and  othe*-  support  training  literature.  Students  are  assigned 
to  residen'  schools  by  the  services  persunnel  system  or  by 
units  on  a space  available  or  quota  basis. 
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Ai  a centra]  or  regional  training  center  witn  a wide  range  of  training 
responi  Ibi  ] 1 ties , a resident  school  often  hes  a variety  and  sopMstlcalion 
of  training  resources  not  likely  to  be  found  in  other  settings.  These 
advantages,  however,  often  can  be  off-^et  by  the  costs  of  trainee  housing, 
travel,  a d tine  away  from  other  assigned  duties.  Also  much  training  does 
not  require  su:h  highly  sophisticated  resources. 

While  the  above  instructional  settings  are  the  ones  to  which  you  will 
nominate  tasKS  in  this  block,  this  aoes  not  mean  there  are  no  other  legiti- 
mate Gettings  for  other  types  of  training,  for  exariple,  group  training  is 
a traditional  system  for  co'"'Jni eating  information  on  selected  topics. 

■^he  usual  apr.roach  has  been  to  gather  groups  together  and  to  designate 
someone  to  present  the  infomiatio.s  or  demonstrate  the  '•kills  to  the  audi- 
ence. It  is  much  like  a classroom/lerture  situation,  and  as  in  that 
situation,  it  is  possible  to  use  other  delivery  systems  as  a substitute 
for  the  lecturer.  It  is  effectively  used  to  satisfy  essential  personal 
knowledge  training  not  re''ated  to  specific  duty  assignments,  such  as  drug 
abuse  and  race  relations,  and  for  required  reviews  such  as  chemical, 
biological,  and  radiological  warfare  training. 

Another  setting  is  generally  referred  to  as  work  experience.  It  is 
nonstrurtured  with  little  or  no  formal  supervision,  ■’s  not  necessarily 
progressive,  and  does  not  require  performance  tests.  The  trainee  may  gpi; 
rielp  by  a,.k'ng  another  job  incumber, t,  by  observing  another  incumbent,  o'- 
by  using  a job  performance  aid.  Work  experience  can  be  usefijl  where  tiie 
trainee  has  prior  o.-  simultaneous  instruction  at  school  or  by  sel f- teaching 
exportable  packages.  It  gives  hands-on  experience  which  usually  i.icreases 
interest  in  traifiing  and  allows  for  the  tiainee  'to  be  productive  while 


bti.ng  trained-  It  tan  he  particularly  effective  ir,  a job  lotdfirn  where 
there  arc  o large  number  of  i ncuinban is  uerf'onni  ng  the  saiK  taiko  . Wort 
experience  may  be  u^ed  for  tasku  n^t  selected  for  traininj  In  Rlock  J.2. 

Cotit  are  a critical  factor  in  all  phav.-';  of  the  ISL)  model.  The 
primary  toncern  is  that  money  epent  for  ivaining  be  spent  efficiently. 
Careful  conrJ deration  of  costs  should  reduce  the  number  of  "rurprif.es" 
such  as  unpreditted  expenses  incurred  in  a training  program  as  a result 
of  failure  to  take  the  ftml  system  into  account. 

Is  If  cheaper  to  offer  a ss- 1 r-teachi luj  exporta>'le  package  (i.-TCh)  char, 
to  offer  resident  school  (dS)  training'.'  Is  the  short  tenii,  in  cases  where 
STLf’  can  iiKiet  Ltie  same  training  ncM'd  as  Rt,  tin;  cost  of  developing  and 
using  jII-.P  may  actual  ly  b?  higher  than  tnt  cost  of  on  Rf.  (.■uurse.  How- 
ever, in  the  long  run,  ',TtP  training  may  prove  to  be  less  expensive  than 
rts. 

What  about  FOJT?  Generally,  FOJT  is  t.hought  to  be  cheaper  than  RS 
in  those  cases  where  i.nth  can  ireet  the  tnining  need,  hut,  for  FOJT  to 
oe  effective,  a iiicnjgement  system  is  required  to  handle  the  instruction 
and  materials.  If  the  ent're  system  has  to  be  built  it  will  require  many 
years  to  pay  back  the  dcvelopnsnt  and  ii;.p lementation  costs.  While  a 
savings  may  eventually  be  realized,  all  factors  in  the  system  must  be 
cOiisidorccl  before  one  can  say  that  FO-lf  is  less  expensi".."  tiian  Ri. 

Fach  serv-ce  i.s  based  on  a different  organization  and  has  different 
mixes  of  resources  and  capabi  1 i t- es . What  will  work  well  in  the  Mr  Force, 
FOJT  for  example,  cannot  ',’ork  as  well  in  the  Army  unti  i the  managernent 
:ystem  is  available  because  the  Army  has  not  depended  on  FCJT  es  a part 
of  their  total  training  system.  The  Navy  is  well  established  and  organized 


for  extensi ve  F0-)T.  So,  in  part,  yout  reC(xi»rR.nddtions  for  trainlm)  setting 
will  depend  heavily  upon  whether  you  are  '■.oncerned  with  the  Arny,  ‘lavy,  Air 
Force,  or  Marines  and  upon  the  capabilities  you  have  for  developing 
ins 'ruction. 

Because  of  the',  considerations  such  as  the  different  organizational 
structures  in  the  different  services,  the  ISO  method  for  considering  costs 
of  pr-oposed  training  settings  is  as  follows: 

The  initial  recomnrendation  of  assignment  of  tasks  to  settings  should 
[■e  based  on  the  procedures  to  be  described  in  this  block.  The  procedures 
are  based  primarily  on  factors  other  than  costs.  This  recoiuipindaticn  for 


assignment  must  be  accomplished  in  a manner  that  is  in  accord  with  ISD 
procedures  and  also  in  reasonable  accord  with  local  requirements.  After 
the  initial  recowuendation  is  made,  the  reconmendations  should  be  reviewed 
with  affected  local  manageTOnt,  Local  managers  will  be  in  the  best  posi- 
tion to  know  specific  costs  in  their  services,  what  resource.s  are  avail- 
able, time  requi reinents  to  react  to  demands  placed  upon  them,  und  other 
pertinent  facts  that  effect  the  cost  of  training. 

A process  of  negotiation  and  trade-offs  must  be  tarried  out,  based  on 
the  technical  considerations  revealed  by  the  procedures  described  in  this 
block  and  the  management  requirements  for  carrying  out  the  decisions 
reached.  This  negotiation  may  reveal  alternatives  which  have  not  been 
considered  before  or  which  have  not  been  given  serious  cunsideration.  Tliis 
trading  off  of  technical  and  maragement  requirements  that  results  in  the 
final  assignment  of  tasks  to  instructional  settings  must  be  a cooperative 
management  effort  that  takes  into  consideration  the  best  available  cost 
i r'formation . As  the  costs  associated  with  each  setting  beconr:  more  widely 
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available,  the-,e  data  can  i>i>  used  In  mtHno  the  initial  ’.election  of 
setti  ny. . 

The  procedures  for  selecting  the  instructiunal  setLing  consist  of 
using  data  collected  in  fUeck  {.?,  the  job  perfoniance  measures  developed 
in  Block  1.3,  and  (.'ersonnul  assigtiiiient  infoniiation  collected  in  tnis  block 
to; 

1.  Determine  if  a task  should  have  a JPA  developed 

2.  If  the  task  is  not  assigned  to  a JPA,  select  the  appropriate 

instructional  setting  from  among  the  reniainino  settings. 

This  selection  is  based  on; 

a.  training  supervision  requirements 

b.  training  resource  constraints 

c.  at  what  point  in  time  in  the  Individual's  service  career 
performance  of  the  task  will  be  required 

d.  decay  rats  of  the  task 

e.  the  percent  of  the  DOS  performing  the  task 

f.  the  number  of  individuals  to  be  trained  and,  if  a large 
numoer  of  individuals  must  be  t-ained  simultaneously,  the 
size  of  the  groups. 

The  steps  in  carrying  out  these  procedures  are  shown  in  Figure  1.29, 
the  fold-out  page  at  the  end  of  this  block. 

The  output  of  this  block  will  include  a reconmended  instructional 
setting  roc  each  task.  As  witli  many  other  steps  in  the  ISD  process,  some 
of  the  decisions  made  in  this  block  may  bo  modified  later  when  new  infor- 
mation becotrios  available  as  the  instructional  program  is  developed.  The 
final  instructional  setting  selection,  for  example,  may  assign  parts  of  a 
task  to  different  settings. 
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Curtain  ba5ic  skills  such  as  using  hand  tools, 
following  an  electrical  wiring  diagram,  or 
O'^erating  sirnple  test  equipioent  might  be  taught 
in  --chool,  and  a large  number  of  tasks  that 
require  the  above  skills  miylit  be  tought  FOJT. 

Thu  organi zation  of  the  armed  services  generally  results  in  tiie 
instructional  setting  selection  being  done  early  as  part  of  the  anaivsis 
ptiaso.  This  permits  early  management  awareness  of  future  training  facility 
and  manpower  requi ren^'nts . A high  level  ot  management  should  be  involved 
in  instructional  sotting  selection,  since  the  final  decisions  often  must 
bo  compromises  between  perceived  training  needs  and  proposed  training 
resourr.er  a i Inrations. 

There  are  three  principal  purposes  for  giving  serious  consideration 
to  setting  selection: 

1.  To  insure  that  training  is  effective  wherever  it  is  conducted. 

2.  To  insure  that  effective  training  is  conducted  at  the  lowest 

cost  possible. 

3.  To  insure  that  necessary  incre.'’ses  in  the  costs  of  training 

are  thoroughly  justified  on  the  basis  of  increased  effective- 

ness. 


To  be  able  to  make  all  of  these  decisions  totally  on  the  basis  of 
known  fe"tors  and  costs  would  be  the  ideal  situation.  These  data  are  not 
now  available  in  precise  fonn,  but  each  service  has  collected  enough  data 
to  provide  a good  starting  point. 

The  recomnendations  and  procedures  that  follow  are  based  on  r wiews  of 
current  practices,  research  data  that  typically  deal  w1  tli  only  one  setting 


244 


at  a Mme,  and  estimated  benefits  and  constraints  of  alternatives.  To 
establlsii  more  valid  criteria  for  selection  will  require  considerable 
time  and  experience. 

It  Is  rpcwnriended  practice  that  those  responsible  for  the  developiient 
or  conduct  of  training  In  each  of  the  alternative  settings  be  consulted 
prior  to  tlie  final  assignment  of  a cluster  of  tasks  to  a setting.  These 
discussions  should  reveal  any  potential  problems  before  final  decisions 
are  made. 


2.0  PROCEDURES 


2.1  Cl  us  ter  Tasks 


T 


j 
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While  it  nay  be  desiruble,  and 
evo.i  necessu.'y  in  some  cases,  to 
assign  each  Individual  task  to  a 
setting,  it  is  probably  more 
efficient  to  cluster  tasks  before 
proceeding.  Clustering  is  a pro- 
cess of  recognizing  conditions 
and  constraints  which  would  stroi  jly  ' 

influence  or  control  tiie  setting  selection.  These  general  conditioi^s 
and  constraints  include  the  following; 

1.  Skill  l-'vel  or  rank  of  the  trainee.  Trainees  early  in  their 
c.ireers  are  more  likely  to  perform  some  tasks  than  others, 
if  the  task  is  perforii.ed  by  all  skill  levels  in  a DOS,  it  will 
reauire  different  consideration  than  if  it  is  performed  mainly 
by  one  skill  level.  4 first  clustering  '•■hould  be  made  on  the 
basis  ov  the  skill  level. 
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2.  Neod  for  special  facilities,  c:juinment,  or  personnel.  Some 
settings  will  be  eliminated  when  there  are  special  needs  for 
facilities  and  equipment  such  as  gunnery  ranges,  submarines, 
aircraft,  and  overhaul  aid  repair  shons.  Some-  tasks  require 
the  use  of  specialized  personnel  in  the  training  or  testing 
'..f  the  task.  If  these  special  resources  are  regui red,  the 
tasks  should  be  clustered  accordingto  tiie  special  require- 
ments . 

3.  Other  constraints.  The  third  step  is  clustering  any  other 
tasks  which  have  constraints  not  listed  above. 

Ihe  remaining  tasks  .hould,  whenever  possible,  be  clustered  with 
similar  tasks.  If  some  tasks  ere  left  over,  each  of  them  must  be  treated 
as  a cluster. 


lul  Oetermine  for  Which  Tasks  Job 
The  next  stop  in  selecting 
instructional  settings  is  to 
■’dtermine  v.'hich  task?  cr  parts 
of  tasks  would  not  have  to  be 
trained  if  JPAs  were  developed. 
Tasks  that  ca  easily  be  per- 
formed by  using  JPAs  then  can 
be  assigned  to  that  setting 
and  deleted  from  your  list 
of  tasks  for  which  other 
settings  must  be  selected. 


Performance  Aids  -Should  be  Developed 
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Some  tasks  have  a high  delay  toler^ince;  that  Is,  considerable  delay 
ca.T  be  tolerated  betoveen  the  time  the  need  for  task  perforrrance  becomes 
evident  and  the  tiiTie  actual  perfomsnce  must  begin.  Such  tasks  are  good 
ciindidates  for  development  of  more  complex  JPAs. 

tXAIfL^S 

1.  Issue  supplies  against  approved  orders. 

2.  Rev  ill  fire  extinguishers  after  use. 

3.  Complete  SF  91  form  folloMing  an  accident. 

4.  Answet  telephone  inquiries. 

5.  Repair  aircrait  servicing  equipment. 

It  is  not  essential  to  design  a single  JPA  for  use  everj'where  the 
task  Is  performed.  For  example,  while  the  above  task  c*"  "answer  tele- 
phone inquiries"  might  easily  be  performed  by  using  a JPA,  the  JPA  might 
have  to  be  adapted  to  local  needs.  The  responsible  agency  tor  developing 
JPA?  could  develop  JPAs  to  serve  the  different  needs  of  each  using  command, 
or  issue  an  instruction  that  would  assi.st  each  using  conmand  in  develop- 
ing thei'r  own  JPA.  If  the  JPA  is  carefully  developed,  nothing  else  may 
be  required;  the  incumbents  c.an  satisfactorily  per'orm  the  tusk  singly  by 
following  the  JPA. 

Fo."  some  tasks,  any  deity  in  correct  pet.ormance  would  cause  damage  to 
equipment,  endanger  personnel,  or  render  performances  of  the  task  useless. 
It  is  .not  reasonable  to  depend  solely  on  conn'ex  JPAs  tor  such  tasks. 

CXAMPLLS 

1.  Provide  first  aid  for  severe  bleeding. 

2.  Snap  fire  at  an  unexpected  eneiny. 

3.  Secure  submarine  for  emergency  Jive. 
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!n  the  previou'.  exaniple,  decals  and  attached  reference  labels  might 
be  used  in  souk  initances. 

Several  other  factors  must  be  considered  when  deciding  for  which 
tasks  JPAs  5‘^ould  be  developed: 

1.  Task  coniplexi  ty . Tasks  Lhai.  follow  a relatively  set 
procedure,  consist  of  relatively  easy  to  follow  steps, 
but  O'-e  fiot  performed  often  eno' gh  to  be  sa.sily  remembered, 
are  gtod  candidates  For  oPTcj.  Frequencly  performed  iiii.iltipln 
casks  wher'O  the  procedures  are  complex  require  more  complex 
JPAb  iod  con.,iK|uently  more  JPA  development  time. 


EXAMPLES 

1,  The  jt.  engine  mecnanic's  task  of  "tag  engine 
containers"  follows  a set  procedure  of  rela- 
tively few,  simple  steps.  The  actual  tag 
might  also  be  the  JPA,  here,  the  JPA  could 
be  a substitute  for  training. 

2.  The  jet  engine  ineclianic's  tosk  of  "install  engine 
in  aircraft"  is  much  more  complex.  While  some 
form  of  JPA  probably  is  available  for  double 
checking  critical  items,  to  depend  completely 

on  the  JPA  would  be  unrealistic.  Here,  it  would 
be  necessary  to  provide  training  on  the  use  of 
the-  JPA  and  perhaps  training  on  basic  skills. 


Task  conditions.  Certain  physical  cotiditions  sucli  as  location, 
weather,  and  available  space,  under  which  the  task  must  be  per- 
fonied  could  make  use  of  a JPA  impractical. 


EXAMPLES 

1.  The  operator  of  certa-.n  underwater  rescue  equipment 
might  be  in  such  a cramped  position,  he  would  not  be 
able  to  read  a JPA. 


2.  If  a task  must  bo  performed  in  total  darkness,  a cotiplex 
JPA  would  be  useless . 

3.  There  might  not  be  room  In  a tank  or  submarine  for  a 
number  of  bulky  JPAs  such  as  these  used  in  maintenance 
tasks . 

4.  Tasks  pirformed  In  frigid  weather  or  heavy  r-jinfall 
might  not  be  suitable  for  JPAs  or  would  have  to  be 
specially  designed  for  tliose  conditions. 

5.  If  the  consequences  of  inadequate  performa  r.e  of  a task 

are  severe,  and  If  there  Is  a possibility  t.iat  the  JPA 
will  he  lost,  daiwqert,  or  destroyed,  total  dependence 
should  not  be  placed  on  the  JPA  t 


3.  Ta£k  physical  skills  requirements.  JPAs  generally  are  roc 
suitable  for  tasks  that  require  o high  degiee  of  physical 
skill. 

.'i 

EXAHPLf.S  j 

1.  Hitting  a target  with  an  M-16  rifle. 

2.  Flying  a jet  aircraft  at  tree-top  altitude. 


I 

i 
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Using  the  above  factors  as  a nuid»line,  determine  if  a JPA  should  be 
developed  for  the  particular  tasks  und'ir  consideration.  If  the  decision 
is  no^  to  develop  a JPA.  you  should  proceed  to  t.Te  following  sections  and 
make  a setting  decision.  However,  if  the  decision  is  to  assign  the  taj k 
to  a JPA,  the  procedure  described  below  must  be  followed. 

1.  The  JPA  is  developed  end  validated  by  the  group  responsible 
for  this  activity  in  your  services.  Development  of  JPAs  i;. 
discussed  in  Block  III. 4. 
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2.  Use  of  the  JFA  b>  Job  incumbents  will  change  the  con-11  tiims 
under  which  the  task  is  perfortwd,  and  may  change  the  eleir^nts 
that  make  up  the  task.  The  task  will  not  bi  the  same  as  it 
was  before  the  introduction  of  the  JPA. 

3.  This  revised  task  may  or  may  not  be  se.lecte  I,  in  Block  1.2, 
for  training.  If  the  task  can  easily  be  performed  sinf  ly 
by  us.ng  the  dP.A,  it  will  not  be  r.eV'cted  for  training.,  and 
you  will  have  no  further  concern  with  it.  If  the  revised 
task  is  selected  for  training,  because  ever,  with  the  JPA 
some  training  is  required,  tlio  reviled  task  will  end  uo 
back  at  this  point  in  ihis  block  to  be  assigned  to  one  of 
the  reiiiainlruj  instructional  s^'ttingi. 


II 


2.3  Secure  Required  Personnel  Assignment 
Most  of  the  infijrmatlon  you  will 
need  for  making  instructional  setting 
decisions  Is  already  available  from 
the  previous  blocks  In  this  model. 

However,  several  critical  items  must 
be  secured  from  other  sources.  Some 
of  the  factors  upon  which  assignment  of 
a task  to  an  instructional  setting  is 
based  ore  the  probable  numbers,  group 
sizes,  and  locations  of  those  who  will  be  required  to  learn  the  task. 

The  implications  for  assignment  of  a task  to  a setting  w.hen  approximately 
one  individual  per  day  is  assigned  to  a DOS  in  units  in  various  parts  of 
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Uie  worlo  i;,  cotii iderably  different  than  if  365  people  mu'jt  be  trained 
jt  tile  same  tinr;  at  the  same  l()cation. 

The  required  data  can  usually  b.  obtained  from  the  personnel  section 
at  your  school.  Wliile  ,u'.h  infor'iiat ion  often  is  estimated  rather  than  in 
sppcific  predecermined  fiqures,  the  estimates  should  be  sufficient  as  a 
basis  for  your  decisions  in  this  block. 

2.4  petermirip  if  Tasks  Should  be  f'sminated  for  Self-Teaching  exportable 
P ackaqes  (Si'EPs) 

No  sinqle  factor  controls  nomination  of 
tasks  to  the  rcinaininy  instructional  stttinq.s. 

No  rules  can  be  stated  that  prescribe  a 
sperifir  settinq  for  a task.  How-ver, 

given  that  should  prove  helpful 
in  makintj  logical  decisions.  Details  of  these 
guidelines  are  given  in  the  remainder  of  this 
u'l  ock . 

The  appropriate  ins iructional  seating  for  nomination  of  the  cluster 
of  task.5  is  a self-teaching  exportable  package  (STtP)  if: 

1,  Training  of  the  tasks  is  not  likely  to  require  close  supervision, 

2.  There  are  no  critical  resource  constraints  (everything  required 
for  training  can  easily  be  included  in  the  training  package, 

or  is  readi 1y  available  to  the  user), 

3,  New  assignees  to  units  are  not  required  to  perform  the  t.asks 
(there  is  time  for  learning  before  the  tasks  a^e  required),  and 

4.  Practice  is  not  tl.e  primary  factor  in  pe-formance  of  tne 
physical  skills  involved. 
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If  the  c’uster  of  tasks  "eets  all  four  of  the  guidelines  listed.  It 
can  be  nominated  for  STtP.  If  one  or  more  of  the  guidelines  are  not  met, 
the  tasks  should  be  considered  for  nominaMon  to  one  of  the  rE-malnlnj 
settings.  Following  is  a discussion  of  each  of  the  guidelines  listed 
previously. 

Training  of  the  tasks  i , 'lotJUeJ^  clos.  supervision 

The  important  factors  here  are  whetlier  relatively  unsupervised 
training  could  result  in  injury  to  personnel  or  damage  to  equip- 
ment, and  whether  immediate  feedback  from  a supervisor  is  likely 
to  be  required  to  learn  the  tasks.  A wide  variety  of  these 
tasks  exist  and  some  are  more  suitable  than  others,  depending 
on  the  neeoa  of  the  service. 

EXAMPLES 

1.  Contract  administration  and  drafting  tasks  would 
not  likely  require  immediate  supervision  and 
could  be  trained  without  risking  injury  to 
personnel  or  damage  to  equipment.  Such  tasks 
are  candidates  for  STEP. 

2.  "Install  jet  engine  bearings"  would  not  be  a 
candidate  for  STEP  since  close  supervision  would 
be  required  while  the  trainee  is  learning  parts 
of  the  task. 

2.  There  are  no  critical  resource  constraints.  If  every  tiling 
required  for  training  the  tasks  can  easily  be  included  in  the 
training  pacKage,  or  is  readily  available  to  the  users,  the 
tasks  remain  a candidate  for  STEP.  If  special  faci lit-es , 
environmental  conditions,  terrain,  or  equiprrent  arc  required, 
the  tasks  should  not  be  considered  for  STEP  unless  the»o  is 
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'’edsondlilp  certainty  that  such  resources  will  be  availf.ble 
to  the  Irdinees.  Usually  Sit?  programs  are  limited  to  tasks 
where  tli'>  nei.ejSdry  equipment  and  other  resources  are  easily 
and  inexpensively  exportable  to  the  trainee  or  available 
wherever  he  is  stationed.  Also,  since  STEP  traininq  neneralli 
is  a part  tiri.c*  activity  for  the  trainee,  any  required  training 
equipment  sefit  to  him  is  not  likely  to  be  fully  utilized, 
Tiierefore.  the  cost  of  equipment  .iiust  be  given  careful  con- 
sideroticjn, 

EXAMPLES 

1.  Prinled  fi 'teridls , eudio-visual  aids,  small 
hand  tools,  a. id  small  kits  such  as  radio 
construction  kits  are  examples  of  items  that 
can  be  included  in  a STEP. 

2.  Tasks  that  require  a gunnery  ranne,  an  aircraft, 
or  a L'nk  trainer  usuailv  are  not  candidates  for 
STEP. 


3,  1^  assignees  to  units  are  not  required  to  perfotmi  the  task. 

A STEP  can  be  used  if  there  is  sufficient  time  for  the  trainee 
to  learn  the  tasks  before  lie  ■•s  required  to  perform  them, 

One  way  to  make  this  determi nation  is  to  examine  data  from 
Block  1.2  on  time  between  job  entry  and  task  performance. 

This  is  discussed  in  detail  in  Section  2. 1,1,8  of  Block  1.2. 
You  should  use  estimates  of  task  learning  difficulty  obtained 
from  1,2  as  one  estimate  of  this  time,  and  the  tiirxa  between 


job  entry  and  task  perfonnance  as  a second.  If  ^asks 
require  a long  time  to  learn,  other  settings  may  be  more 
efficient. 


rj«»  estimated  time  for  Icartiinij  some  tasks  may  be  shori  , possibly 
one  hoi'r  or  less,  there  usually  is  sufficient  Lirwe  for  trainees  to 
learn  sud;  tasks  after  assigntm.'til  if  only  n relatively  small  number  of 
tasks  are  involved.  If  a large  number  of  these  tasks  are  involved,  the 
total  learning  time  might  be  sucli  that  some  or  all  of  the  tasks  would 
require  training  before  beginning  the  Job.  This  will  be  discjs"(.d 
further  in  section  2.7  nf  this  block.  At  tin's  point  you  should  base 
your  riecislons  on  the  re.qui rentents  of  the  task  in  the  Lluster.  Later 
you  will  ,nake  any  necessary  ad.justments . 

An  example  of  part  of  a computer  printout  of  the  percent  of  Job 
incumbents  who  perform  certain  tasks  is  shown  in  Figure  1.30.  The  column 
unucr  SkLUOb  shows  the  percent  of  menibers  perforinimj  the  task  wtio  have 
bee.i  assigned  to  the  DOS  for  1-12  months.  The  other  three  columns  show 
the  percentages  for  neniiers  performing  who  have  been  assigned  for  longer 
periods  of  time  The  printout  for  the  first  task  ^hows  that  only  1,109 
percent  of  incumbents  perform  the  task  during  the  first  12  months  of 
service.  For  th's  task,  there  is  ample  time  to  learn  tn.e  task  before 
performance  is  required. 

As  a general  guideline,  if  the  task  is  performed  primarily  by 
assignees  who  have  been  on  the  job  for  moi'e  than  one  year,  the  task 
remains  a candidate  for  STEP  training.  According  to  this  guideline, 
task  3 would  ordinarily  noj^  be  a candidate  for  STEP  training  since  it 
is  performed  primarily  by  first  year  assignees, 

4,  The  task  has  a high  decay  rate,  or  .TS  percent  or  more  of 

chose  in  the  DOS  do  not  perform  the  task.  If  the  task  has 

a liigh  decay  rate;  that  is,  the  task  requires  skills  that 
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tfiP  job  ituumuf'iit  iiiUGf.  ubf  rrMiiilarly  in  ordi’r  to  romain 
proficionl,  till-  Idsl:  tiMii.ii ns  a caiitliilnt.i-  for  STfP  training. 
Tiie  reason',  fc'r  lliis  is  llial  jTfP  irjinimj  tan  be  (|iven  at 
the  point  in  time  when  the  trainee  wi M shortly  be  in  a 
position  to  I'Se  the  task,  llais  retainitKi  tite  acquired 
skills.  On  the  other  hand,  if  the  task  has  a low  decay 
rate;  that  is,  it  can  be  learned  long  before  it  is  required 
and  still  be  perfonnod  adequately  when  needed,  and  if  most 
of  tlie  L'OS  perform  the  task,  the  tasi:  may  be  traitv/ri  more 
efficiently  in  a different  settinq.  Such  casks  usually 
should  .lot  be  as'jigned  to  STtP  training. 

As  was  |)ointed  not  earlier,  if  ihe  tasks  ireet  alj_  four  of  rhc  ijuide- 
lines  discussed  above,  Uicy  should  be  Lenlatively  considered  for  bTLP. 
Some  examples  of  tasks  tiiat  might  be  assigned  to  Sl'Ef'  are: 

EXAMPLES 

1.  transcribe  international  Morse  Codes 

2.  prepare  data  processing  flow  charts 

3.  administer  contracts 

A.  draw  tedmical  charts  and  graplis 

5.  provide  industrial  safety  plans 

6.  interpret  radar  •vesUier  detection  data 

7.  investigate  motor  velricle  accidents 

B.  provide  press  releases 

Task.  1 has  a high  decay  rate.  It  could  be  assigned  to  STEP  if  your 
survey  data  from  Block  1.2  indicate  that  new  assignees  are  not  required 
to  perform  the  task,  Tosks  2-H  have  lower  decay  rakes.  They  could  be 
assigned  to  SIEP  if  new  assignees  are  not  required  to  perform  them. 


i\ 'j  Deterniine  if  Td'ik  5l)ijuH  Lti  ilntiiindti'd  for  forityl  J)r)-Uje -Joh  li'aitiiriij 
(JOJi ) 

I ho  appropridti!  insi.nictinthil 
sotting  for  nomination  rf  U'.p 
olusltT  of  tdsts  is  d foriHj] 
nn-tlio-,job  training  (i'OJT)  program 
if; 

1.  Assignment  of  Lrainoes 
to  units  is  Miado  in 
■;uffi(. icnlly  small 
groups  and  spread 
over  a sufriciontly  'ong  period  of  Liino  Tor  training  of  the 
task  to  he  nbsorLod  by  a FOJf  proiiram, 

it.  Tlioro  are  no  critical  resourct  constraints  (evc-rytiiinq 
I'oguired  tor  training  can  easily  bo  provided  in  the  job 
setting),  and 

3,  (lew  assignees  to  units  are  not  required  to  perform  the  tasks 
(there  is  time  for  learning  before  the  tasks  are  required). 

If  the  cluster  of  tasks  meets  all  four  of  the  quideiines  listed  cibovo, 
it  should  be  tentatively  >-onsidered  for  FOdf.  If  one  or  more  of  the 
guidelines  ore  not  met,,  the  tasks  sliould  bo  considered  for  assignment 
to  one  of  the  rc.tiaimng  settings.  Following  is  a discussion  of  the 
guidelines  listed  above, 

1,  One  of  the  limitincj  factors  for  FO.JT  is  the  number  of 

individuals  who  can  lie  trained  at  one  time.  FOJt  is  usually 
dependent  upon  close  supervision  hr  qualified  personnel. 
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This  limits  the  number  of  trainees  to  those  for  whom  such 
supervision  can  he  provided.  In  addition,  since  FOJT 
assumes  that  trainees  will  work  with  the  real-world  job 
facilities  ard  equipn«nt,  the  availability  of  facilities 
and  equipment  in  the  job  setting  limits  the  nunter  of  trainees. 
The  decision  as  to  the  nuni)ers  of  trainees  who  can  reasonably 
be  absorbed  into  FOJT  trust  initially  be  based  largely  on 
Inputs  from  units  where  the  FOJT  likely  would  take  place, 

2.  In  addition  to  the  resource  constraints  mentioned  above, 

FOJT  should  be  selected  as  the  training  setting  only  if  the 
resources  for  training  are  available  or  can  easily  be  made 
available  on  the  job.  Since  training  has  not  yet  been  de- 
veloped, you  must  make  assumptions  about  training  requirements 
based  on  the  job  performance  measures  (JPMs).  If  the  JPM 
requires  a great  deal  of  simulation,  particularly  if  it 
requires  c simulator  that  is  not  normally  used  when  performing 
the  task,  FOJT  should  not  be  selected  as  the  instructional 
setting. 

3.  There  must  also  be  a local  management  system  to  supervise 
the  FOJT  program. 

As  was  pointed  out  earlier,  if  the  cluster  of  tasks  meets  the  guide- 
lines discussed  above,  it  should  be  tentatively  considered  for  FJJT. 

This  does  not  mean  STEP  cannot  still  be  included  as  part  of  the  training 
program,  Selecting  FOJT  as  the  instructional  setting  means  that  primary 
responsloi li ty  for  training  rests  on  those  who  administer  the  FuJT,  and 
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that  j ii.ajor  portion  of  tl.e  Iraiiiimi  takes  place  on  the  Job.  STEP  can 
be  used  to  support  or  supplenunt  the  rOJT.  Some  exanples  of  tasks  that 
probably  could  be  assirjned  to  TOJT  are: 


IXAMPLfcS: 


1,  install  onnine  bcarinqs 

?.  refacc  er.tjine  valves 

j.  replace  refrigerant  reheat  valves 

4.  set  up  rtiobile  radio  equipment 

5.  make  radio  uhone  patches 

6.  coordinate  air  to  ground  traffic 

7.  Install  high-voltage'  lines 

8.  splice  cables 

9.  grade  roads 

10.  pc-rfonn  pre-flight  check  procedure 


2,6  Determine  If  Tc.,k  Should  Be  iJominatcd  For  Installation  Support 


Scliools  (fSS) 

The  instructional  setting 
lioinina  A for  the  cluster  of  tasks 
may  he  an  installation  support 
school  (ISS)  if; 

1 , lliere  are  no  cri  tical 


resou>"ces  constraints 


C'] 


(everything  required  for 
training  can  easily  be 
provided  at  tlie  ins  tall  a- 


I 

LIZ}' 


tion  support  school  or  schools  for  the  urit  or  units  where 
tliG  training  is  requirea),  and 
2,  ri'P  tasks  have  a high  decay  rate. 
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If  the  cluster  tasks  meets  the  guidelines,  it  could  be  tentatively 
assigned  to  ISS.  Along  with  this  assignment,  you  should  make  a recom- 
mendation as  to  whether  the  tasks  should  be  trained  to  all  members  of 
the  005  or  only  at  specific  ISS  for  individuals  assigned  to  specific 
units.  Consider  the  task  of  "construct  arctic  shelter."  There  are 
several  reasons  for  recorwiiending  that  this  task  be  taught  only  at 
certain  ISS  to  individuals  assigned  to  specific  units,  first,  tne 
training  resources  will  be  found  only  in  ISSs  in  frigid  climates, 

Further,  only  the  members  of  the  DOS  in  these  specific  locations  are 
likely  to  perform  the  task.  This  points  out  one  of  the  major  advantages 
of  ISS,  ISS  is  one  means  of  minimizing  training  a large  number  of 
individuals  who  are  never  likely  to  perfois"  the  task,  or  of  t»'aininq 
individuals  long  before  the  tnining  is  requireu.  If  new  JPAs  are  to  be 
introduced,  training  in  their  correct  use  could  be  provided  in  ISS. 

2,7  Determine  if  Tasks  Should  be  Nominated  for  Resident  Tchool  (RS' 

Where  large  groups  of  indi- 
viduals must  .be  taught  the  same 
thing  ?t  the  same  time,  RS  can  often 
provide  effective  and  efficient 
trail  i -.q. 

After  you  have  nominated  one 
cluster  of  tasks  for  an  instruc- 
tional setting,  you  should  repeat 
the  procedure  for  each  task 
cluster  until  all  have  been  nominateu. 
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2.8  Review  Nominations  and  Revise  as  Required 
Once  you  have  nominated  clusters 
to  instructional  settings,  you 
shoul(^  review  your  setting  selections 
and  possibly  change  some  of  them. 

3oire  reasons  for  this  are: 

1.  You  might  have  assigned 
so  many  tasks  to  ST3P  or 
FOJT  that  there  is  not 
enough  time  to  train 
the  tasks  before  they  must  be  performed. 

2.  You  might  i,ave  assigned  so  many  tasks  to  FGJT  that  the 
units  cannot  handle  that  much  FOJT  without  di?  -jpting  their 
essential  work  activities. 

3.  So  few  tasks  might  have  beer,  assigned  to  a setting  '..hat 
administrative  costs  outweigh  any  advantages  of  training 
the  few  tasks  in  a different  setting,  ’"his  is  particularly 
true  if  only  a small  nurrber  of  individuals  require  training. 

4.  Resource  and  time  constraints  in  the  development  of  training 
A/ould  delay  onset  of  training. 

5.  Toe  management  review  of  the  nominations  might  reveal  that 
training  in  one  setting  was  much  less  expensive  than  the 
same  "raining  in  another  setting.  This  information  will  be 
cumulative  through  time,  but  will  be  handled  on  a case-by- 
case basis  until  e.xperience  allows  easier  cost  comparison;. 


r™.— 


Tliu  iiidn.i'ji;iiH.'fit  n'vii-w  w.jy  tlisu)vor  tuuiy  prot’lniiii  or  d i f fi i oH'it,';  wi  tti 
tlio  it'.iLidl  d',si grmi'.'tits , part  iculdrly  in  Lfie  aroar.  of  i;ostr>  and  over- 
luiuJimj  cortain  parts  of  tho  systom.  boino  tasks  will  be  rear, signed  to 
other  settings  for  rccsons  of  iniiicdidte  practical  necessity,  llowi-ver, 
tliroiigh  time,  changes  \i  policies  and  training  emphasis  will  occur  as  tlie 
data  base  improves. 

Tl:e>'e  ofcen  are  good  reasons  to  assign  a task  to  two  or  niore  settings 
witii  the  undors Landing  that  parts  of  the  task  or  different  degrees  of 
proficiency  in  performing  Lliu  task  will  bo  taught  at  each  setting.  In 
some  cases  there  are  needs  for  olLernative  settings  for  tlie  same  task. 

OAMPLf 

Training  the  task  of  'repair  electronic  components"  might 
profitatily  be  assignc''  to  several  settings.  Some  of  the 
fundamentals  such  as  soldering  connections,  using  common 
tool  and  test  equipment,  and  identifying  components  iniglit 
be  taught  in  f!S  or  ISS.  Once  these  entry  level  skills 
I are  mastered,  the  trainee  might  complete  liis  training  FOOT. 

e 

& 

t While  at  this  point  in  tlie  model,  since  training  has  not  yet  been 

developed,  you  cannot  make  a final  decision  as  to  which  part  of  a task 
will  be  trained  in  which  setting.  However,  a tentative  decision  at 
tin’s  point  to  assign  a task  to  more  than  one  setting  often  is  a practical 
option.  To  do  this,  you  will  have  to  make  assumptions  about  training, 
based  on  the  task  documentation  and  the  JPM.  To  determine  which  settings 
are  practical  requires  the  same  kinds  of  discussion  outlined  previously 
in  Sections  2.3  - 2,6. 
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2^ 9 Secure  Man?gun)erit.  Approval 

As  was  discussed  earlier,  the  final 
de-isioti-j  on  assignment  of  tasks  to  Instruc- 
tional settings  generally  is  made  by  a 
process  of  negotiation  and  trade-offs 
at  a higher  management  level.  However, 
these  final  decisions  cannot  be 
realistically  made  unless  you  have 
provided  a logical  base  for 
nominations  of  tasks  to  setting;;. 

This  logical  base  will  result  from 
careful  considpration  of  the 
guidelines  given  in  this  block. 

3.0  OUTPUTS 
The  outputs  of  this  block  should  consist  of: 

3.1  Products 

The  instructional  setting  or  settings  to  which  each  task  was  assigned. 
Note;  Implied  in  the  setting  selecfon  are  decisions  as  to  whether 
each  task  should  be  trained  to  all  in  the  DOS  or  only  to  certain  units 
and  the  point  in  an  individual's  service  career  at  which  each  task  most 
likely  will  be  trained. 

3 . 2 Other  Documentation 

1.  Any  tiplicit  statements  of  specific  units  or  individuals 
who  should  or  should  not  be  trained  ior  a specific  task, 
and  the  rationale  for  the  statements. 
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?.  I\  til  I Liiir'd  * nf  any  1’j‘j  where  Lrainiiifi  '.houU) 

be  usiii|ni'(l,  ain)  Uie  rai-iniiMle  fm  the  •,  I a LeiiK-tit, . 
j.  Any  'j(L‘U'fiL  crilieiil  unit  iriiiut'.,  re«.i(lijMl,  bctiool  inpitl-,, 
or  cubb tra Int'i  that  affected  Itie  selectivii  nrocebb , 

‘J.  A '.ummary  btalcnienl  (jf  any  revision  to  tile  or1(j1nai 

settiiKi  Seleition,  and  the  rationale  fnr  the  ;ijvisions. 
j.  Any  other  coimients,  findiinis.  or  suof)es ti o:is  that  could 
iiiip.n  l the  iiiotruclional  dcjsi'pi  and  devt.f  ripinen L . 
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DETF.RMINE  IF  TASK  SHOULD 
Bt  NOMINATGD  FOR  FORMAL 
ON-JOB  TRAINING  (FOJT). 


FIGURE  ] 7d.  Fliiwcliait  ol  Ulouk  L5.  SELECT  INSTRUCTIONAL  SETTING. 


RCrtRfNCES 


PHASE,  I 


Block  IJ 

Clit  i',.  Id  I , I'.  1.  The  United  States  Air  Force  Utc  Jpdtional  Research 
Project.  In  IV'  '.Idle  of  the  art  Jn_ occu£atJonal  reseurVi  ajd 
de_Vj  loj."iui2iL,  Syiiipo:. 'iim  presented  dt  Ihe  Nuvy  pi  r i^ohncH  kes'earch 
and  De'/e  I opulent  Center,  San  nieuo,  L..1if,,  July  10- 1?,  19/3. 

Sore  aspects  about  *he  techniques  developed  by  ttie  Air  Force  foi' 
calli'cting,  analyzing,  and  reporting  otcupat’oiidi  data  are  r’e- 
portei.  Ihe  job  inventory  method  of  collecting  wurk-tesk  infor» 
iiidticn  fru'ii  largo  n'sinhers  of  workers  is  described.  Ttiis  technique 
was  cnosen  by  the  Air  Force  because  of  its  economy,  the  quantiti- 
fication  ol  the  job  data  and  sebsequent  ease  of  handling  by  com- 
puter, and  tlie  fart  that  the  inlorination  can  be  validated  and 
cEiccki.’d  for  stability. 

Oepartnient  of  the  Air  Force.  Instructional  system  development  (AFM 
^0-2).  Washington,  D.C.:  "Headquarters,  United  Stales  Air  Force, 

Air  iraiiring  Comi'and,  December  1970. 

This  manual  servos  as  the  guioe  for  applying  the  Air  Force  systems 
approach  to  the  development  of  education  and  training  programs.  It 
presents  a tecnnology  of  instructional  design,  ano  presents  the  model 
for  developing  cost-effective  instructional  systems.  This  manual 
applies  to  all  education  and  training  personnel  who  plan,  develop, 
approve,  administer,  or  manage  Air  Force  instruction  and  its  support- 
ing materials . 


Di'|,'<irttiiLTit  o)-'  thii  Ait'  (ini.t-',  Tp*'  d<^!.'ynurs  of  instructional 

iiV-'j teiiib:  TdSk  analysis  (Vol,  II,  AFP  50-56).  Wa'sMngtoTi,  U.C.  : 

Headquarter's,  U'liited  States  Air  Force,  July  1973. 

PMt  t of  d five-volume  approiirh  to  instructional  design,  this  Air 
force  paiiiplileu  describes  in  detail  the  breakdown  of  a job  into  Its 
subcoiiiponents . It  furtiier  explains  how  the  Air  force  accompli  si, es 
job  analysis.  In  addition,  this  volu:ne  details  the  procedutes  for 
identi  Fyiny  and  establishing  JnFi  Per  forma  nce  Hequirements  (.IPi’.s) 
ami  the  Irainimj  Kef|uiroments  (THs). 


Department  of  the  Army.  Systems  engineering  ot  Lrainiiig  (course  design) 
(TKADOC  Reg  350-100-lTi  Ft)  Monroe,  Va.:  HeatTouarters , Unitt'l 

States  Continental  Army  Command,  May  1D6R. 

The  systeais  engineering  approach  to  course  design  provides  an  n,'derly 
pi'oeess  of  gathering  and  analyzing  job  performance  requircinent:  , of 
preparing  and  conducting  training,  and  of  evaluating  and  improving 
the  effectiveness  of  the  training  program.  Job  analysis,  the  ,1rst 
step  in  systems  engineering,  consists  of  identifying  the  job  an!  de- 
veloping the  task  i nventory--both  of  wliich  serve  as  the  framewo  k with- 
in which  all  subsequent  steps  follow. 


Morsh,  J.  E.,  & Archer,  W.  B.  Procedural  guide  for  conducting  occupational 
surveys  in  the  United  States  Air  Force  (PfiL  TR-67-11).  LacFlandAiT' 
Force  Base,  Texas:  Personnel  Research  Laboratory,  Aerospace  Medical 

Division,  Air  Force  Systems  Command,  September  1967. 


The  procedural  guide  sets  forth  in  detail  the  procedures  for  collecting, 
organizing,  analyzing,  and  •reporting  information  describing  work  per- 
formed by  Air  Force  officers  and  airmen.  Specific  steps  in  the  appli- 
cation of  the  Air  F' rco  method  of  job  analysis  are  presented  in  chrono- 
logical order. 
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Amt-r  i Cd J ' M3 york: 

Several  chapter^  in  this  book  are  useful  when  dealing  with  the 
job  analysis  phase  of  the  design  and  development  of  an  instructional 
system.  Iracey-s  systems  emphasize  the  importance  of  building 
aimng  program  on  joD-relevant  data  and  he  describes  methods  for 

data  corection  that  are  intended  to  be  accurate  reflections  of  the 
person  on  the  job. 


Tracey,  W.  R.,  Flynn,  E.  b.,  8 LeoerA  r i i rh  ^ i 

ynjctimal  systems:  P^oreriSts  le.'.l ' ' ?£ Jn- 

rutiiTKw  StH7rtyT(foT^  'Oft  Oevens,  Hass.:  United 

T(.is  maneal  details  iirocedures  fnr  acl>1e,i„g  training  oljeai.es  „hlcn 
ha;e  been  .lased  on  valid  job  data.  Tne  procedures  outlined  that  are 
to  be  used  In  performing  job  analyses  are  built  upon  objectively- 
collected  job  data  based  upon  the  „i,  the  job  in  the  field.  Such 
procedures  eliminate  the  inclusion  of  irrelevant  content,  the  omission 

Of  required  content,  misplaced  emphasis,  and  ultlwtely,  an  under- 
trained  or  overtrained  man. 
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Block  l.-X 

Dt  ptji  tinent  of  the  Navy,  Uesigii  of  courses  of  instruction  (MLO  Plb10.113A). 
Wa-jhinrjton,  D.C.:  HeaH^artin's , l)ni ted' States  MaTIno  Corps,  November 

197P. 

When  the  job  analysis  has  been  completed,  the  master  list  of  duU?s, 
tasks  and  task  elements  identifies  the  mental  and  manual  skills, 
knowledge,  and  attitudes  required.  The  selection  of  tasks  to  be 
taught  in  the  school  environment  implies  a selection  of  tasks  to  be 
taught  elsewhere,  most  probably  on  the  job.  Guidelines  to  assist 
in  the  detennina ti nn  of  fhe  tasks  to  be  included  in  formal  train- 
ing arc  discussed  and  the  behaviors  the  individual  must  perform  in 
a field  environment  are  emphasized  as  necessary  training  considera- 
tions in  this  document. 

McCluskey,  M.  R , Jacobs,  T.  0.,  & Cleary,  F.  K.  Systems  engineering  of 
training  for  eight  combat  arms  MOS  (HuinRRO  draft  technical  reportlT 
TTTexandria,  Va.;  Human  Resources  Research  Organization,  June  1973. 

The  basic  objective  of  this  project  was  to  develop  task  inventories 
and  jou  task  data  for  93  duty  positions  in  eight  of  the  key  combat 
MOSs  (IIB,  nr,  IID,  HE,  13A/C,  13E,  16P,  and  16R)  using  systems 
engineering.  Much  of  these  task  it^ventories  were  validated  and  in- 
dicate the  extent  tn  v/hich  task  statements  are  common  across  various 
combinations  of  duty  positions.  Based  on  the  degree  of  non-comiiionfll  i ty , 
the  results  also  include  implications  for  the  reorganization  of  an  MOS. 
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PHASE  1 

Block  1.3 

D2partJH9nt  of  the  Air  Force.  HdOdbook  fot  tie;. ignev  '.  of  in  .iniLtiondl 
bYSteiiib:  Task  dnaVy^ls  (Vol . II,  AFP  SO-A-i . H.jchingFor,,  U.C.: 

Headquarters , United  States  Air  Force,  July  1971. 

This  volume,  part  of  a five-volume  series  of  manuals  on  inslruc- 
tinnal  design,  outlines  procedures  for  a job  ta'k  analysis.  The 
process  of  deterniinin j tin?  tasks  required  of  the  job  holder  and 
the  standard  of  performance  results  in  job  performance  require- 
ments. Determining  the  changes  needed  in  skills,  knowledges, 
and  atti tiides,  so  that  they  can  reflect  job^  become  training 
requi rcments . Both  of  these  rcquiram6nt.s  are  major  insly  uctiuunl 
design  activities  within  this  volume  which  later  serve  as  inputs  to 
developing  objectives. 

Department  of  the  Army.  Systems  engineering  of  training  (TRADOC  Reg 
350-100-1).  Ft.  Monroe ,'TaTl  Headquarters , Training  and  Doctrine 
Command,  April  1972. 

Since  training  objectives  are  derived  front  training  content,  train- 
ing objectives  cannot  be  limited  to  those  things  that  are  easily 
measurable  within  the  sch.ol  environment.  This  manual  suggests 
the  use  of  evaluation  criteria  to  insure  the  successful  accom- 
plishment of  the  training  objective.  Evaluation  criteria  include 
action,  conditions,  and  standards,  and  ideally,  u|pr"xiniata  the 
requirements  of  the  training  objective. 
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Gropper,  G.  L.  A technology  for  developing  instructional  materials: 
Plan  simulation  based  on  instructional  and  logistical  needT 
(Vol.  E).  Pittsburgh,  Penn.:  American  Institutes  for  ?.esearch. 


1971. 


This  manual,  part  of  a multi-volume  set,  provides  instructions  on 
the  use  of  a programmed,  self-instructional,  transportable  train- 
ing program  in  instructional  technology.  In  particular,  this 
volume  emphasi2es  using  simulation  based  on  data  about  criterion 
behaviors. 


-lohnson,  E.,  & Mirabella,  A.  Test  fidelity:  Congruence  of  test  con- 

ditions with  actual  Army  tasks.  Proceedings  of  the  16th  Annual 
Conference  of  the  Military  Testing  Association,  1974,  590-595 . 


The  increasing  movement  towards  performance-based,  high-fidelity 
testing  conflicts  with  the  problem  of  reducing  the  cost  and  en- 
vironmental impact  of  training  and  testing.  Simulated  approaches 
to  testing  for  appropriate  job  tasks  can  meet  the  logical  con- 
straints imposed  by  full  performance  testing  and  also  provide 
acceptable  levels  of  predictive  validity.  This  paper  describes 
a general  framework  for  the  test  fidelity  problem,  reviews  the 
state  of  the  art,  and  summarizes  some  research  efforts  currently 
in  progress  at  the  Army  Research  Institute. 


Mager,  R.  L.  Measuring  instructional  intent.  Palo  Alto,  California: 
Fearon  Publishers,  1974. 

The  importance  that  measures  be  relevant  to  what  they  are  supposed  to 
be  measuring  is  stressed  in  this''short  book.  Most  difficulties  arise 
when  objectives  show  no  performance  and  when  items  do  not  reveal  which 
students  can  perform  as  desired. 
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Marine  Corjis  Development  and  Educatinr  Command.  Ane lysis  of  perfonnan^ce 
requirements  (lAC  UilUi*).  Quantieo,  Va.;  Instructor  Training 
5cnoo1 , tduca t i ona 1 Center,  n.d. 

"Analysis  of  Perfoniiance  nequiremenis"  provides  a brief  hut  sys- 
tematic '^esci'iptiun  of  job  analysis  procedures.  Techniques  for 
subdividing  jobs  into  duties  and  tasks  for  the  development  of 
performance  measures  are  presented  in  a highly  ordered  fashiuri. 

Osborn,  W.  C.,  Harris,  J.  II.,  S Ford,  J.  P.  Functionally  integrated 
performance  testing.  Proceed ings  of  the  16th  Annual  Conference 
of  the  Military  Testing  Assoc  fat  ion','  T9‘/4, 

Because  it  preserves  the  initiating  cues  of  the  real  work  environ- 
ment, the  functionally  integrated  tost  should  be  able  to  claim  a 
higher  level  of  valiaity  than  more  conventional  periormance  tests. 
Further,  the  higher  validity  may  not  raise  the  cost  of  the  per- 
formance test,  since  the  functionally  integrated  tost  would  require 
no  more  equipment  than  would  tests  on  the  separate  tasks.  Of 
course,  in  economy,  it  cannot  compare  with  group  administered  paper- 
anil-pem  il  tests  or  with  ratings  of  job  proficiency,  but  it  sfiould 
at  least  offer  a highly  relevant  criterion  against  which  they  can 
be  objectively  validated. 

Swezey,  K.  W.,  & Pearl  stein  R.  l3.  Ueveloping  cri  terior.-referenced  test 
Rpston,  Va.:  Applied  Science  Associates,  19. ’4. 

This  manual  presents  an  overall  procedure  for  developing  and  using 
cri terion-referenced  tests.  Particularly  helpful  are  the  chapters 
on  item  format  and  level  of  fidelity.  Process  and  product  measures 
are  discussed  with  ■'ugijestions  for  approiniate  rating  scules,  as 
well  as  good  examples  of  tliese  scales. 


Taylor,  il,  C.,  Michaels,  E,  K,.  A Brennan,  M.  r.  The  concepts  _of  per- 
fot‘iiijfn..e-or ionted  instruction  used  in  d.>vc'l oping  tlie  experiincntdl 
V0 1 un teer  At tra i ri i ng  pj'o^rain  (tc-chr.ic^  ReporTTS^J.  Alexandria, 
Va.:  Human  Re'soiirces' RescarcKTirq.'inizatiori,  March  i972. 

This  n;porL  describes  the  planniruj  and  implementing  of  the  Expcri - 

muntal  Volunteer  Army  Traininq  I’l  ucjr.iin  (EVATf)  at  Fort  Ord  early 

in  19/1.  This  was  tlie  Army's  first  effort  to  effect  major  traininy 

innovations  in  the  conversion  toward  an  all-volunteer  Army.  By 

the  fall  of  1971,  this  program  was  being  used  as  a model  for  ini- 

plementiny  the  EVATP  at  other  Aniiy  Training  Centers.  In  u'eveloping 

thr.;  EVAlP  system,  six  established  learning  principles  were  applied 

to  Basic  Combat  Training  a"d  Advanced  Individual  Training  to  i.iodify 

the  conventional  training  system.  Course  objectives  and  perfonnance 

tests  use<i  were  developed  jointly  by  Fort  Ord  and  HumRPO.  In  a coiti- 

i parison  with  a conventionally  trained  group,  independently  conducted 

i 

I by  the  Infantry  School  at  Fort  Benning,  CVATP  graduates  performed 

I significantly  better  on  five  out  of  seven  BCT  subjects,  and  seven 

[ out  of  nine.  AIT  subjects.  In  general , these  gains  were  shown  by 

i men  at  all  levels  of  aptitude. 

I 

r 

I 

Tho’’ndike,  C.  L.  (Ed.).  Educaticnal  measurement.  Washington:  American 

Coum  il  on  Edu'^ation,  .971. 

The  use  of  simulation  is  discussed  in  several  articles.  Particularly 
insightful  is  the  article  by  Robert  F i txpa ' r ick  and  Edward  J.  Morrison 
''Performance  and  Product  Evaluation,"  which  explcres  simularion  in 
terms  of  perfonnance  tests, 
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Braby,  P.,  Henry,  J.  M. , Parriiit,  W.  K. , Jr.,  & Swope,  W.  M.  A technique 
for  choosing  cost-effective  instructional  delivery  systems  (TA EG 
Report  No.  16).  Orlando,  Fla.:  Department  of  the  Navy,  Training 

Analysis  and  Evaluation  Group,  April  1975. 


A major  consideration  in  the  choice  of  instructional  setting  is 
financial  resources.  The  TECriP  model  offers  training  specialists 
a procedu:  e for  choosing  instructional  delivery  systems  appropriate 
to  various  types  of  military  training. 


Christal,  h.  E.  The  United  States  Air  Force  Occupational  Research 
Project.  In  The  stats  of  the  art  in  occupational  ‘"cscarch  and 
development.  Symposium  presented  at  the  Navy  Personnel  Researxh 
and  Oevelopinent  Center,  San  Diego,  Calif.,  July  10-12,  1972. 


This  project  was  designeci  to  develop  iw '.hodologies  in  job  analysis 
(work  performed  by  personnel);  job  evaluation  (grade,  pay,  and 
skill  levels);  job  structures  (job  engineering);  job  requirements; 
career  development,  personnel  utilization,  and  job  satisfaction. 


Department  of  the  Air  Force.  On-the-job  training  (AFM  50-23).  Wash- 
ington, D.C.:  Headquarters,  United  States  Air  Force,  July  19'',3. 

This  manual  describes  procedures  for  the  planning,  conducting, 
administering,  and  supervising  of  OJT  programs  de. igned  to  train 
technical  personnel  in  a minimum  amount  of  time.  The  dual-channel 
CJT  program  described  is  designed  to  provide  trainees  with  career 
knowledge  and  job  proficiency  skills. 
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Department  of  the  Army.  Trainer  development  program  (TRADEP)  progress 
report.  Fort  lienning,  "Ga.  : United  States  Army  Infantt^  School^ 

January  19/5. 


i 

I 


T(ie  TRADtP  program  presents  a course  oT  instructor  training  designed 
to  he  used  with  accompanying  outside  resources  on  the  major  training 
functions.  Ihe  course  covers  needs  assessment  through  course  eval- 
uation and  quality  cont'^ol. 


Deterline  Associates.  Developing  i nstructor -free  instruction  (Task  VI. B 
Report,  Contract  No.  N61 339-73-C-0150) . Palo  Alto,  California: 
Deterline  Associates,  1975. 


The  manual  provides  instruction  on  the  development  and  writing  of 
correspondence  courses,  STEP  lessons,  and  how  to  convert  existing 
courses  to  sTEPs. 


Gay,  R.  M.  Estimating  the  cost  of  on-the-job  training  in  mllHar.y 
occupations:  A meth'odQlogy  and  pilot  study  (R-1351-ARF'AI  Santa 

Monica:  T)ie  P. a nd  Corpor’a t ion,  April  19?4. 


This  report  introduces  a method  of  estimating  (costing)  on-the-job 
training  costs  and  determinants  of  OJT  in  military  occupations. 
Relationships  between  training  costs  and  personal  attributes  of 
the  trainee  are  discussed. 


Haverland,  G.  Transfer  and  use  of  training  technology:  A mode!  for 

matching  train. approaches  witF  craining  settings  ( Interim  Report) 
Alexandria,  Va.:  Human  Resources  Research  0rgani2,.tion , October  1974 


A model  which  is  designed  to  evaluate  tr.iining  approaches  or  innova- 
tions in  relation  to  specific  training  settings  is  presented.  The 
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model  j1  lows  the  comparison  of  the  charocteristics  of  various  t;'ain 
in5  approaches  with  the  corresponding  characteristics  of  various 
training  settings. 


Joyce,  R.  P.,  Chenzoff,  A.  P.,  Mulligan,  J.  L. , & Mallory,  W.  J.  fuJJx 
proceduralized  joh  performance  aids:  Handbook  for  JPA  developers. 

Brooks  Airl^orce  Ba se,  texa s . Air  Force  Systems  Command,  llunian 
Resources  Labo.’atory,  December  1973. 


Detailed  instructions  for  the  preparation  of  two  major  types  of 
fully  proceduralized  JPAs  are  described;  job  guides  and  fully 
I rocedural ized  troubleshooting  aids.  Instructions  for  performing 
the  behavioral  task  analysis  and  for  validation  and  verification  of 
JPAs  ar«  discussed. 


Stephenson,  R.  W. , & Burkett,  J.  R.  An  action  oriented  review  of  the 
on-the-job  training  literature  (ATFiRl-Tll-74-6^T  Brooks  Air  Force 
Base,  TeJ<as"l  Air  force  Human  Resources  Laboratory,  December  1S74. 


This  is  a review  of  civilian  and  military  literature  on  OJT  a;i  well 
as  all  current  Air  Force  regulations,  manuals  and  other  documents 
governing  or  describing  the  OJT  system.  Innovations  in  training  ana 
their  applicability  to  Air  Force  OJT  programs  are  described. 
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GLOSSARY 


ACRONYMS 


AFS  - Air  Force  Speciality 

AR  - Army  Regulations 

CMI  - Computer  Managed  Instruction 

CRT  - Criterion  Referenced  Test 

CODAP  - Comprehensive  Occupational  Data  Analysis  Programs 

DOS  - Defense  Occupational  Specialities 

FM  - Field  Manuals 

FOOT  - Formal  On  The  Job  Training 

GEO  - General  Educational  Development 

HQ  - Headquarters 

ISO  - Instructional  Systems  Development 

ISS  - Installation  Support  School 

ITV  - Instructional  Television 

JPA  - Job  Perfo“TTiance  Aids 

JPM  - Job  Performance  Measure 

KOP  - Knowledge  of  Results 
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LO  - l.uarning  Objective: 
l.S  - Learning  Step 

MODIj  - Military  Occuprif  ional  Data  Ran!. 

MOS  - Military  Occupational  Specialities  ( Army/Mur iue  Corps) 

MWO  - Modification  Work  Order.s 
NIH  - Not  Invented  Here 

NOTAP  - Naval  Occupational  Task  Analysis  Prcgraifi 

OJT  - On  The  Job  Training 

OSn  - Occupational  Survey  Report 

POI  - Program  of  Instruction 

QQPRI  - Qualitative  and  Quantitative  Personnel  Requireifiencs  Identification 

RS  - Resident  School 

SME  - Subject  Matter  Expert 

SMP  - System  Master  Plaii 

SOP  - Standing  Operation  Procedures,  Standard  Operating  Procedures 
STEP  - Sel f-Teachi ng  Exportable  Package 
TAK  - Trai  ler  Appraisal  Kit 


TI  - Traditional  Instruction 
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1 

T 
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TLO  - Torinirii)!  Learning  Objective 
TM  - Technical  Manuals 

TOE  - Tables  of  Organization  and  Equipment 
TRAOOC  - U.S.  Training  and  Doctrine  Coiiinand 
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GLOSSARY 


JILITV  GROUPING:  Arranyement  whereby  students  arc  assiynod  to  groups 

on  the  basis  of  aptitude  testing. 


3S0LUTE  STANDARDS:  A statement  defining  the  exact  level  of  performance 

required  of  a studf  ,t  os  a demonstration  that  he  has  mas- 
tered the  course  o.-jf;ctive(s) . Cri  tcrion-referenced  tests 
are  usually  tiased  on  an  absolute  standard. 


IHIEVEMENT  GROOPING:  Arrangement  whereby  students  are  assigned  to 

groups  according  to  their  performance  on  pretests  of  units 
of  the  course. 


:TI0N:  Occurs  in  tcniiinal  learning  objectives  and  learning  objectives; 

describes  the  specific  behavior  the  learner  is  to  exhibit 
after  training. 


TION  VERBS:  Verbs  that  convey  action  and  reflect  the  type  of  learn- 

ing that  is  to  occur.  Action  verbs  must  reflect  behaviors 
that  are  measureable,  observable,  verifiable,  and  reliable. 


TIVlfY  STEP:  One  simple  operation  or  movement  that  comprises  part  of 

a job.  A job  performance  standard  consists  of  a list  of 
these  operations  or  movements. 


lUNCT  PROGRAMMING:  A method  of  combining  the  features  of  good  exist- 

ing instructional  materials  (e.g.,  films,  textbooks)  with 
special  directions  or  questions  to  guide  the  learner. 


1INISTRATIVE  CRITERIA:  In  media  selection,  the  optioris  that  course- 

ware be  developed  locally  or  at  some  central  location. 


lOP.ITHM:  A rule  or  procedure  for  accomplishing  a task,  or  solvirig 

a problem. 


HANUMERIC:  Refers  to  a combination  of  letters  and  numbers;  for 

example,  on  the  keyboard  of  a teletype. 


lRNATE  PATH:  Refers  to  elements  which  have  relationships  in  which 

the  specific  situation  encountered  determines  the  appro- 
priate sequence,  or  it  may  be  another  way  of  meeting  the 
same  objective. 
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ASSESSMENT:  A judginent  of  the  effectiveness  and  efficiency  of  a 

training  system,  in  terms  of  measurement  and  evaluation. 


ASSOCIATION  DEVICES:  Memory  aids,  techniques  which  ease  recall. 

Mnemonic  devices. 


ATTITUDE:  A persisting  state  of  a person  that  influences  his  choice 

of  action. 


AT'’ ITUDE  MEASURE:  An  instrument  designed  to  gather  information  about 

how' people  feel  tov;a rd  a particular  object.  This  could 
include  liking  or  disliking  subject  matter,  usefulness 
of  a medium,  or  , opinions  about  the  medium. 


AUDIO-ONLY  PROGRAM:  A production  which  does  not  contain  any  video 

nr  pictures ; for  example,  a record  or  radio  program. 


AUDIO  PRODUCER:  Prepares  tape  recordings  and  produces  audio  programs. 

The  audio  producer  combines  narration,  music,  and 
other  sound  effects  in  the  production  of  an  audio  pro- 
gram. 


AUDIOVISUAL  MEDIA;  Refers  to  any  device  such  as  television  or  film 
which  is  both  seen  and  heard. 


BASELINE  DATA:  Valid  and  reliable  information  about  the  current 

level  of  performance  of  the  intended  student  population. 
This  data  can  be  used  to  confirm  the  need  to  develop  new 
instruction,  or  can  be  used  as  a comparison  in  ascer- 
taining differerices  between  students'  performance  be- 
fore and  after  instruction. 


BEHAVIORAL  ATTRIBUTES:  Qualities  or  activities  that  jharacterize  an 

object  or  process.  Behavioral  attributes  characterize 
each  category  of  learning. 


BLOCK  SCHEDULING;  Mode  of  instruction  whereby  0.II  students  receive 
the  same  instruction  ai  the  same  time. 


tllOCKING; 
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Rt'Tt'rs  to  the  procoi',  of  defining  and  illustrating  the 
different  camera  movements  end  ca'.iera  shots  in  a tele- 
vision or  film  script.  A blocked  script  may  also 
contain  directions  as  to  the  movement  of  actors  as  wei ! 
as  scenery  changes. 


CHt.rKLIST;  Job  performance  aid  which  lists  the  elements  of  .1  task 
irithe  sequence  of  eyecution.  The  job  holder  places 
a check  beside  each  element  as  it  is  accoiiipl  ished,  thus 
insu*'inq  that  the  i.ask  is  completed. 


CHRONOLOGICAL  OKUERj  Arranging  content  in  order  from  one  topic  to 
another  based  on  when  they  occurred  in  time. 


COMMON-FACTOR  LLARNING  OBJLCilVES:  Refers  to  learning  objectives  th.it 

are  identical,  or  that  have  identical  action  words  and 
similar  objects  of  the  action  in  the  learning  objective 
sta tement. 


COMPARATIVE  SEQUENCE:  Sequencing  which  starts  with  familiar  topics 

and  gees  to  unfamiliar  ones. 


COMPLEXITY  CRITERION:  In  media  selection,  the  degree  of  complexity 

required  of  instructional  materials  in  order  to  ade- 
quately train  students  to  meet  learning  objectives. 


COMPUTER  MODELS  TECHNIQUE;  Occurs  during  the  simulation  of  an  opera- 
tional system;  involves  having  a computer  simulate  the 
major  operations  of  the  system,  under  a variety  of  condi- 
tions . 


CONDITIONS:  Occurs  in  terminal  learning  objectives:  describes  what 

is  presented  to  the  student  in  order  to  accomplish  the 
specified  action,  that  is,  it  describes  the  important 
aspects  of  the  performance  environment. 


CCNTIGUITY:  Refers,  in  learning,  to  the  prit.ciple  that  events  which 

occur  closely  together  become  associated  by  the  learner. 


COm  iNGENCY  MANAGEME.NT : The  establisi;;.  ‘ : of  a set  of  procedures  by 

wiiich  trainees  are  required  to  perform  a certain  amount  of 
work  or  to  achieve  certain  objectives  before  engaging  in 
activities  that  are  preferred  by  the  trainee  (e.g.,  recrea 
tion,  a break,  or  a more  desirable  training  event). 


COURSE  DOCUMENTATION:  Information  describing  the  current  content 

of  a course  (instructional  materials,  tests,  instructor's 
manual,  evaluation  plan,  student's  manual)  and  its  develop- 
mental history  (job  analysis,  criteria  for  selecting  tasks 
for  training,  previous  revisions). 


CLUSTERING:  A process  of  organizing  many  tasks  into  groups  for  the 

purpose  of  deciding  upon  the  optimal  instructional  set- 
ting mix  for  that  group  of  tasks. 


CRITERION-REFERENCED  TEST:  Measures  what  an  individual  can  do  or 

knows,  compared  to  what  he  must  be  able  to  do  or  must 
know  in  order  to  successfully  perform  a task.  Here  an 
individual's  pe'^formance  is  compared  to  external  cri- 
teria or  performance  standards  which  are  derived  from  an 
analysis  of  what  is  required  to  do  a particular  task. 


CRITICAL  CUE:  Cue  which  must  be  correctly  interpreted  by  the  student  be- 

fore we  can  correctly  perform  the  associated  task. 


CRITICAL  SEQUENCE:  Sequencing  of  topics  or  objectives  according  to 

their  importance. 


CUE:  A word  or  other  signal  that  initiates  or  guides  behavior;  a 

prompt. 


CUT-OFF  SCORE:  Minimum  passing  score. 


DATA:  Collection  of  facts  or  numerical  values  resulting  from  observa- 

tions of  situations,  objects,  or  people. 


DATA  COLLECTION  PLAN:  An  outline  of  the  procedures  and  techniques 

that  will  be  used  to  gather  information  for  any  specific 
purpose. 


DATA  RECORDING  PLAN:  Method  of  tabulating  background  responses  and 

test  data. 


DECAY  RATE:  The  amount  of  time  it  takes  a trainee  to  forget  what  he 
has  learned  in  school.  If  the  decay  rate  is  high  then  a 
trainee  should  not  receive  instruction  in  a specific 
task  until  shortly  before  he  will  actually  perform  it. 
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OECISfON  TREE:  Flowchart;  graphic  representation  of  the  sequence  cf  a 

specific  activity  or  operation. 


DELIVF8Y  SYSTEM:  Any  methoo  containing  plans  and  prcceduros  for  the 

presentatinn  of  instruction.  Platform  instruction,  tnle- 
«ision,  fudl,  and  STEPs  are  all  deliver’y  systems. 


DEPENDENT  RELATIONSHIP:  Occurs  when  skills  and  knowledges  in  nno 

learning  objective  are  clu-.c-ly  rel.ited  to  those  in  ttie 
other  learning  objective.  In  order  to  itidstc'r  one  of  the 
learning  objectives,  it  is  first  necessary  to  learn  the 
other. 


DOWNTIME;  Refers  to  the  period  of  time  when  equipii'ent  is  inoperable. 


DUTY-  One  of  the  major  subdt vi'*  ions  of  work  per  formed  by  one  indi- 
vidual. One  or  more  iluties  constitute  e Job. 


DUTY  TITLE:  Categorizes  groiq)'.  of  t.isLs  under  identi  F iable  head- 

ings to  help  in  tke  crgaiiizing  of  lists  of  tasks. 


EMPIRICALLY  CASED  REVISION:  Revision  based  on  the  results  of  test 

data  and  the  collection  of  other  types  of  quantitative 
information. 


ENTRY  BEHAVIOR;  The  skill,  knowledge,  and/or  attitude  required  be- 
fore beginning  a new  segment  of  instruction;  also  may 
refer  to  the  capability  a person  has  prior  to  new- 
learning. 


ENTRY  SKiLLS;  Specific,  incasuraLi'e  behaviors  that  have  Deen  determined 
through  the  process  of  analysis  of  learning  require- 
ments to  be  basic  to  subsequent  knowledge  or  skill  i--'  the 
course. 


ENTRY  SKILLS  TEST:  A 'Measurement  instrument  designed  to  determine  if 

a student  already  possesses  certain  skills  oi'  knowledge 
needed  as  a prerequ i',i  te  before  under  taking  now  instruc- 
tioo. 


ENTRY  TEST:  Contains  items  based  on  the  objectives  that  the  intended 

students  must  have  iMi'.ste.-'od  in  order  tu  begitr  the  lourse. 


iiutiiHii'aiMBi’iiwii’* 
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ERROR  OF  HALO:  Occurs  when  an  observer  sometimes  allows  his  rating 

of  performance  to  be  influenced  by  his  general  impres- 
sion of  a person. 


ERRORS  OF  LOGIC;  Occur  when  two  or  more  traits  are  being  rated,  it 
is  p»esent  if  an  observer  tends  to  give  similar  ratings 
to  traits  which  do  not  necessarily  go  together.  The 
traits  are  related  only  in  the  mind  of  the  person  making 
♦■he  error. 


ERRORS  OF  STANDARD:  Occur  when  observers  tend  to  rate  perfonners  too 

high  or  too  low  because  of  differeai^'S  in  their  standards. 


EVALUATION:  The  process  of  interpreting  the  results  of  measurement 

data  (e.q.,  tests,  Jf’Ms)  for  the  purpose  of  making  a 
judgment  or  decision  on  the  instruction  or  on  the  success 
of  a trainee. 


EVALUATION  CRITERIA;  The  measures  used  to  deteraiine  tlie  adequacy 
of  performance. 


EVALUATION  PLAN:  A metl.od  or  outline  of  what  set  of  procedures  will 
be  used  to  gather  data  and  information  for  the  purpose 
of  assessing  a course  of  instruction. 


EXTERNAL  CUES:  Signals  for  action  that  exist  outside  of  the  student 
(conditions,  features,  or  characteristics  of  the  job 
environment  that  trigger  action). 


FALSE  NEGATIVE:  Occurs  when  a person  can  perform  the  ■*'.ask  but 

receives  a failing  score  on  the  test. 


FALSE  POSITIVE:  Occurs  when  a person  cannot  perform  the  task  bui. 

receives  a passing  score  on  the  test. 


FEEDBACK:  ’♦'he  return  of  information  L Forma tica  on  student  per- 

formance is  "fed"  back  to  the  student  so  that  he  can 
improve  that  performance;  to  the  iii-structional  dosign.'r 
so  that  he  can  improve  materials  and  procedures  on  the 
basis  of  student  needs;  to  the  management  s/stom  so  it 
can  monitor  the  internal  and  external  integrity  of  the 
instructioii  and  make  appropriate  revisions.  Or,  refers 
to  the  flow  of  data  or  infoima tion  from  one  step  in 
the  ISD  Model  to  others. 


atllL' 
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FOJT— FORMAL  ON-THE-JOB  TRAINING:  This  type  of  training  takes  place 
in  the  actual  Mork  situation. 


FOLLOW-UP  ACTIVITIES:  The  work  events  that  occur  after  a course  of 
Instruction  has  been  completed. 


FORMATIVE  EVALUATION:  The  iterative  process  of  developing  and 
improving  instructional  materials  and  procedures. 


FIDELITY:  Refers  to  how  well  the  actions,  conditions,  cues,  and 

standards  of  the  JPH  approximate  those  of  the  task. 


FIELD  USER  NEEDS:  The  general  and  specific  duties  that  will  have 
to  be  taught  to  the  trainee  if  he  is  to  be  able  to 
adequately  perform  in  a real  world  environment. 


FIRST  DRAFT  MATERIALS:  Any  materials  (book,  film,  etc.)  which  are 
not  yet  committed  to  their  final  form.  First  draft 
refers  to  the  fact  that  the  materials  are  still  in 
•rough'  form  and  will  be  revised  on  the  basis  of  test 
results  and  other  data. 


FLOWCHART:  A graphic  representation  of  the  sequence  of  a specific 
activity  or  operation;  decision  tree. 


FRONT  END  ANALYSIS:  Refers  to  job  analysis,  selection  of  tasks  for 
training,  and  development  of  JPMs. 


FIXED  SEQUENCE:  Refers  to  elements  that  are  always  done  in  the  same 

order. 


GRAPHIC  ARTIST:  Designs  and  prepares  a wide  variety  of  visual  illu- 

strations such  as  graphs,  charts,  and  diagrams. 


GRAPHIC  SCALE:  Measurement  device  which  includes  some  type  of  number 
line  on  which  students  indicate  their  attitude  toward 
a social  object. 


Gf  NO-GO;  Pass-fail;  criterion  of  evaluation  whereby  student  can- 
not be  "partially  correct".  He  is  either  100%  correct 
(go)  or  incorrect  (no-go). 
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GROUP  MANAGEMENT  PLAN;  Arrangeneiit  whereby  Instruction  Is  scheduled 
and  conducted  for  groups  Instead  of  Individuals. 


GROIP  TRAINING:  A group  of  people  gathered  together  for  the  purpose 
of  receiving  Infonnatlon  or  Instruction  In  the  performance 
of  some  specific  task. 


HARD  DATA:  A direct  and  precise  measure  of  a specific  performance. 

A JPM  is  an  example  of  hard  data  while  an  attitude  question- 
naire Is  a less  direct  measure*  providing  soft  data. 


HIGH  DENSITY  SIGNAL:  A signal  containing  many  cues.  A low  density 
signal  contains  few  cues. 


INDEPENDENT  RELATIONSHIP:  Occurs  when  skills  and  knowledges  In  one 
objective  are  unrelated  to  those  in  the  other  objective. 
Mastering  one  of  the  objectives  does  not  simplify  the 
other. 


INDICATOR  BEHAVIOR:  Refers  to  that  behavior  that  Indicates  the 
presence  of  a specific  attitude. 


INDIVIDUALIZED  INSTRUCTION:  Refers,  In  the  ISD  Model,  to  a management 
scheme  which  permits  Individual  characteristics  of 
trainees  to  be  a major  determinant  of  the  kind  and  amount 
of  instruction  given.  Here,  it  nearly  always  Implies 
some  form  of  self-pacing. 


INSTALLATION  SUPPORT  SCHOOLS:  Organized  and  operated  by  Individual 
units  or  commands  to  meet  local  training  requirements. 


INSTRUCTIONAL  CONDITIONS;  The  amount  of  participation  which  the 
Instruction  requires  of  the  learner.  Instructional 
conditions  may  be  active  (the  learner  produces  or  prac- 
tices) or  passive  (the  learner  sits  and  listens). 


INSTRUCTIONAL  DESIGNER:  Person  who  designs  and  develops  a program  or 
course  of  studies  based  on  a systematic  analysis. 


INFORMATIWi:  Knowledge;  the  facts,  names,  labels,  and  larger  bodies 
of  knowledge  that  are  necessary  for  successful  job 
performance . 
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INSTRUCTIONAL  HANAGEHENT  PLAN:  The  specifications  for  the  scheduling. 

Instruction  and  evaluation  of  trainees  toward  the  goal  of 
course  cootpletion. 


INSTRUCTIONAL  PROGRAM:  The  developMent  of  various  materials  (books, 
audiovisual  productions,  etc.)  designed  to  achieve  a 
specific  training  goal. 


INSTRUCTIONAL  SEHING:  The  vehicle  through  which  a trainee  w.to 

initially  is  not  able  to  perform  a task  becomes  profi- 
cient In  performing  the  task^  for  exanM)le.  performance 
aids,  self-teaching  exportable  packages,  formal  on-Job 
training,  installation  support  schools,  and  resident 
school s . 


INSTRUCTIONAL  SUPPORT;  Learning  resources;  different  kinds  of 

material,  number  of  instructors,  amount  of  time,  etc. 
which  will  contribute  to  the  learning  situation. 


INSTRUCTIONAL  SYSTEM:  The  total  effort,  distinct  from  the  operating 
system  by  location,  authority,  or  mission,  that  is  con- 
cerned With  the  preparation  of  individuals  to  serve  the 
operating  system. 


INTERNAL  CUES:  Internal  biological  signals  that  initiate  or  guide 

behavior. 


INTERNAL  EVALUATION:  Assessment  of  the  effectiveness  of  an  instruc- 
tional program  in  terms  of  student  performance  on 
stated  terminal  learning  objectives. 


JOB:  The  duties  and  tasks  performed  by  a single  worker  constitute 
his  Job.  If  identical  duties  and  tasks  are  performed  by 
several  Individuals,  they  all  hold  the  same  Job.  The 
Job  is  the  basic  unit  used  in  carrying  out  the  personnel 
actions  of  selection,  training,  classification,  and 
assignment. 


JOB  ANALYSIS:  The  basic  method  used  to  obtain  a detailed  listings  of 
duites,  tasks,  and  elements  necessary  to  perform  a 
clearly  defined,  specific  Job,  involving  observations  of 
workers  and  conversations  with  those  who  know  the  Job. 
in  order  to  describe  in  detail  the  work  involved,  includ- 
ing conditions  and  standards. 
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JCi  FIDCLin:  Tht  <i^ree  to  Mhich  a tastlns  situation  truthfully 
and  accurately  reflects  the  job  situation. 


JOB  PERFOHHANCE  HEASUIICS:  Tests  that  are  used  to  evaluate  proficiency 
of  a Job  holder  on  each  task  he  perfoms. 


JOB  PERFOfdMNCE  TEST:  Test  used  to  detenalne  whether  or  how  well  an 
Individual  can  perforw  a J(^.  In  aay  Include  either  all 
of  the  Job  perfonaance  measures  for  a particular  Job  or 
a subset  of  the  Job  perfonaance  measures. 


JPA-- JOB  PERFOmANCE  AID:  A checklist,  instruction  sheet,  or  other 
device  that  offers  a possible  alternative  to  training 
rather  than  an  actual  method  of  training;  they  are  de- 
veloped to  eliminate  or  minimize  training  requirements 
for  some  tasks. 


KNOWLEDGE  OF  RESULTS:  Feedback;  Information  provided  to  the  student 

Indicating  the  correctness  of  his  response.  Evaluative 
knowled^R  of  results  Indicates  what  a student  Is  doing 
right  a*v:  what  he  Is  doing  wrong.  Comparative  knowledge 
of  results  Indicates  how  the  student's  response  compares 
to  the  objective  or  standard  establishes  by  the  Instruc- 
tor. 


LEARNER  CHARACTERICTICS:  The  traits  possessed  by  learners  that  could 
affect  their  ability  to  learn  (e.g.,  age,  I.Q.,  reading 
level,  etc.). 


LEARNING  ACTIVITY:  The  specific  behaviors  a student  performs  during 
a particular  episode  of  learning. 


LEARNING  ANALYSIS:  A procedure  to  Identify  subelements  that  must  be 
learned  before  a person  can  achieve  mastery  of  the 
performance. 


LEARNING  CATEGORY:  A division  of  learning  behavior.  All  learning 
may  be  classified  Into  one  of  four  learning  categories: 
mental  skill,  physical  skill.  Information,  or  attitude. 


LEARNING  EVENT:  The  Immediate  outcome  of  a learning  activity. 
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LEARNING  GUIDELINES:  Statements  which  specify  the  learning  events 
and  activities  appropriate  to  specific  instruction. 
Learning  guidelines  combine  to  form  learning  sub- 
categories. 


LEARNING  HIERARCHY:  Graphically  portrays  the  relationships  among 
learning  tasks  in  which  some  tasks  must  be  mastered 
before  others  can  be  learned. 


LEARNING  OBJECTIVE:  Describes  precisely  what  is  to  be  learned  in 

terms  of  the  expected  student  performance  under  speci- 
fied conditions  to  accepted  standards.  These  learning 
objectives  identify  the  mental  skills,  information, 
attitudes,  or  physical  skills  that  are  required  to  per- 
form the  terminal  learning  objective. 


LEARNING  RESOURCE  CENTER:  Library  containing  instructional  materials 
and  areas  for  viewing  and  study. 


LEARNING  STEP:  Occurs  when  learning  objectives  are  broken  down  into 
smaller  parts. 


LEARNING  SUB-CATEGORY:  A division  of  a learning  category. 


LEARNING  TASK  ANALYSIS:  Procedure  used  in  the  domain  of  intellectual 
skills  to  identify  prerequisite  tasks  that  must  be 
i earned  before  a person  can  learn  a given  task. 


LINK  TRAINER:  Mechanical  training  device  which  simulates  the  cock- 
pit of  an  aircraft. 


RESPONSE  BIAS:  Tendency  to  favor  a certain  response  over  others. 


MANAGEMENT  PLAN:  Program  for  the  assignment,  monitoring,  and  assess- 
ment of  the  personnel,  materials,  and  resources  dedi- 
cated to  a specific  mission,  operation,  or  function. 


MASTERY:  In  terms  of  learning,  refers  to  meeting  all  of  the  specified 

minimum  requirements  for  a specific  performance.  Criteria 
for  mastery  are  defined  in  the  design  phase  of  the  ISD 
Model . 
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MEAN:  Arltlwetlc  avenge  calculated  by  adding  up  all  scores  and 
dividing  by  the  nuaber  of  scores. 


MEASIMMENT:  Consists  of  rules  for  assigning  nuabers  to  objects  to 
represent  quantities  of  attributes. 


MEASUREMENT  ERRORS:  Incorrect  procedures  carried  out  during  the 

aeasuraaant  process  which  Invalidate  the  results.  These 

errors  result  from  unfounded  assuatlons  made  by  judges 
or  raters. 


MEASUREMENT  PROCESS:  The  operations  Involved  In  deteralning  the 

aMOunt  of  an  attribute  (e.g..  skill,  knowledge,  or  atti- 
tude) possessed  by  a student. 


MEDIA:  Means  for  presenting  Instructional  material  to  learners;  for 
example,  books,  audiotapes,  and  filmstrips. 


MEDIA  ALTERNATIVE:  A form  of  instructional  material  that  contains 
the  stimulus  criteria  required  by  a specific  learning 
activity. 


MEDIA  MIX:  Combination  of  different  media  used  to  present  a unit  of 
Instruction. 


MEDIA  POOL:  All  of  the  media  options  suitable  for  a given  unit  of 
1n::truction.  The  final  media  choice  is  drawn  from  the 
media  pool. 


MEDIA  SELECTION:  Is  the  major  means  of  determining  how  Instruction  is 

to  be  packaged  and  presented  to  the  student. 


MENTAL  SET:  A preparatory  mei^tal  adjustment,  or  readiness,  for  a 
particular  type  of  experience. 


MENTAL  SKILLS:  Those  processes  of  ide.-^tifjing,  classifying,  using 
rules,  and  solving  problems  that  involve  active  mental 
processing.  Mental  skills  imply  the  capability  of 
applying  the  learning  to  some  situation  and  denonstrating 
the  mental  skill,  such  as  thinking,  creating,  and 
analyzing. 


PtOIONICS:  Methods  which  Mke  Infomtlon  eisler  to 
ilHs. 


MODE  Of  INSTRUCTION:  Method  of  scheduling  mterlals  presenutlon.  The 
Instructlofiel  ande  my  he  Indlwldyallzed  (self-pacluf)  or 
group  (block  schodutlng). 


MODULE : An  irkii v1  duel  1 zed  self- Ins tructlooel  peickege  usuelly  con- 
taining all  the  necessary  leaterlals  a learner  r»^s  to 
Meet  sane  or  part  of  a temlnal  learning  objective. 


MULTIMEDIA  PACKAGE ; Self-contained  instructional  unit  In  more  than 
one  nedlun. 


NARRATION:  Is  the  voice  overheard  on  an  audiovisual  progran. 


NARRATOR;  Is  the  person  whose  voice  Is  heard  describing  or  con 
upon  the  content  of  a flln,  television  progran,  etc 


NUMERICAL  SCALE:  Measurenent  device  which  associates  verbal  descrlp^ 
tions  of  social  objects  with  nunbers  and  requires  students 
to  Indicate  their  attitudes  by  narking  the  appropriate 
nunber. 


OBSERVATION  INTERVIEU:  Job  holder  Is  observed  In  the  job  envlroment 
perfoming  all  or  a substantial  part  of  the  job;  the  Job 
holder  perfonas  the  job  while  the  analyst  ask  questions. 


OFF-LINE:  Refers  to  any  activity  which  does  not  take  place  as  part 
of  the  regular  production  process. 


OVERLEARNING:  Refers  to  the  continual  practice  on  a learning  task  by  a 
person  who  has  correctly  perfomed  the  task. 


PEER  TirrORING:  A font  of  Instruction  In  which  students  at  the  sane 
or  more  advanced  level  of  knowledge  provide  Instruction 
to  students  at  the  sane  or  lower  level  of  knowledge  on 
the  specific  objectives  under  consideration.  Peer  tutors 
are  not  nenbers  of  the  existing  1nsti\ict1ona1  establlsh- 
nent. 
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PERFOIMANCE  EVALUATION:  The  gathering  of  data  to  specifically 

detenilne  the  success  of  students  on  a specific  task, 
as  a result  of  a training  prograa. 


PERFORHANCC  MEASUISS:  The  absolute  standard  by  which  a job  perfor- 
nance  is  judged.  A perforwince  Measure  is  the  inven- 
tory of  job  tasks  with  each  perfonmnce  objective. 


PERSE  ERATE:  Continue  an  activity  until  it  is  coMpleted.  regardless 
of  the  difficulty,  or  the  appropriateness  of  the  solu- 
tion technique  to  the  problaa. 


PERT— PR06RAN  EVALUATION  REVIEW  TECHNIQUE:  PERT  Is  a Method  of  Moni 
toring  the  flow  of  a large  project  by  breaking  It  down 
Into  sMall  Individual  activities  and  assigning  each 
activity  a specified  aaount  of  tine  for  ccnpletlon. 


PHYSICAL  SKILLS:  Specified  najscular  activities  for  accotnplishlng 
a goal. 


POST  FEEDBACK  DELAY:  The  pause  which  follows  the  pre:;enUt1on  of 
feedback.  This  allows  tine  for  the  correct  response  to 
"sink  In." 


POSTTEST:  A test  adnlnlstered  after  the  conpletlon  of  instruction  to 
assess  whether  a student  has  Mastered  the  objectives  of 
the  course  or  unit. 


PREDICTIVE  VALIDITY:  The  ability  of  a test  score  to  accurately  fore- 
cast future  perfonaance. 


PREDIFFERENTIATION  OF  STIMULI:  Pointing  out  the  distinguishing 
features  of  an  object  and  explaining  the  differences 
between  them. 


PRETEST:  Administered  prior  to  instruction  to  determine  how  much 
the  student  already  knows. 


PROCESS  EVALUATION:  An  early  stage  In  ISO  development  that  identifies 
which  steps  In  the  model  will  be  used  for  the  co(irse  under 
development.  The  purpose  of  the  process  evaluation  Is  to 
describe  and  document  the  actual  developmental  process  for 
this  particular  instruction. 
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PROCESS  STANOMOS:  Refers  to  the  conditiors  which  nist  be  satisfied  for 
a job  to  be  seccossfully  completed.  Process  steedards  refer 
to  seqyeece,  acoiracjf,  speed  of  |>erforMiice.  and  aaeplete- 

MSS. 


PROGRAMCO  INSTMCriQN:  Instructional  Materials  which  present  subject 

Matter  In  a series  of  saall  sequential  units  which  require 
responses  fron  tfie  studwt. 


PWMPT:  A wwrd  or  other  signal  that  Initiates  or  guides  behavior; 
a Que. 


QUALITY  CQRTROL:  Process  of  Measuring  and  evaluating  In  order  to  Main- 
tain course  standards  thr^h  adjustMcnts  In  Instructional 
Materials  or  procedures. 


QUALITY  CONTROL  DATA:  Infonaatlon  which  reflects  the  degree  of  success 

achieved  by  a systcM  or  operation. 


RANOON  SELECTION:  Choosing  people  or  objects  at  randoM  rather  than 
according  to  soMe  systOMatlc  plan. 


RANK  ORDER:  The  asslfpMMnt  of  ranks  to  students.  This  could  refer  to 
groups,  such  as  the  top  101,  or  siMply  listing  each  stu- 
dent froM  highest  to  lowast.  Rank  ordering  Is  appro- 
priate when  there  Is  a need  to  select  the  fastest,  the 
Most  accurate,  or  the  best  producer. 


RATING  ERRORS:  Errors  of  standards,  ratio,  and  logic. 


RATING  SCALE:  A MeasureMent  device  In  which  a student  Must  choose  a 
response  froM  a range  of  choices  arranged  In  a contInuuM 
fron  low  to  high  or  good  to  bad,  etc. 


REGULATIONS:  Rules  for  appropriate  conduct  and  behavior. 

RELIABILITY:  The  consistency  with  which  a test  Measures  the  anount  of 
student  achievement. 


RESIDENT  SCHOOLS:  These  schools  are  designed  to  meet  service-wide 
training  requirements. 
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REVISION  PLAN;  A detailed  outline  o the  procedures  to  be  taken 
to  modify  the  structure  or  content  of  a course. 


REWARD  SEQi^NCE:  Scheduling  the  more  pleasant  activity  to  follow 

the  less  pleasant  activity;  can  be  used  to  provide 
a reward  for  completion. 


SAMPLE:  A portion  or  small  segment  of  the  students  for  whom  instruc- 
tion is  designed. 


SAMP'  1NG  PLAN:  Procedure  for  selecting  a small  but  representative 
group  from  a larger  population. 


SCALE:  In  media  selection,  some  materials  must  represent  actual 

objects  and  accurately  represent  the  dimensions  of 
those  objects.  A model  may,  for  example,  be  full 
scale,  half  scale,  or  on  a 1 to  10  scale  with  the 
actual  object. 


SELF  PACING:  Mode  of  instruction  whereby  each  student  works  through 
the  instructional  materials  at  his  own  rate  of  speed. 


SELF-PACED  MANAGEMENT  PLAN:  Arrangement  whereby  instruction  is 

scheduled  and  conducted  for  individual  students  rather 
than  groups  of  students. 


SELF-TEACHING  EXPORTABLE  PACKAGES;  Sel^  ..istructional  study  units; 

generally  sent  to  the  student  wherever  he  is  stationed. 


SEQUENCING:  Ordering  instruction;  proper  sequencing  allows  the 

learner  to  make  the  transition  from  one  skill  or  body 
of  knowledge  to  another,  and  assures  that  supporting 
skills  and  knowledge  ire  acquired  before  dependent 
performances  are  introduced. 


SHAPING:  Gradually  changing  a student's  behavior  until  it  is  correct. 
SIGNAL:  Cue  that  initiates  and  directs  activity. 
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SIMULATION;  Any  chtngc  froa  reality  or  any  Initatlon  of  reality. 

Three  types  are  coaeon:  simulating  part  of  the  system, 
simulating  the  operation  of  the  systmi.  and  simulating 
the  environment  In  which  the  system  will  operate. 


3INULAT0AS:  Machines  or  processes  desisted  to  provide  training  which 
will  have  high  positive  transfer  to  the  real  world  equip- 
ment or  situation.  Simulators  are  ordinarily  cheaper, 
safer,  or  rn>*^  available  than  the  actual  situation  or 
equipment. 


SLIDE-TAPE:  A oombIrMtIon  of  visual  slides  and  an  audic  tape  syn- 
chronized so  that  the  audio  describes  the  content  of 
the  slides. 


SOFT  DATA:  Obtained  from  attitude  or  opinion  surveys.  This  data  Is 
not  as  reliable  as  hard  data. 


STANDARDS:  Occurs  In  terminal  learning  objectives  or  learning 

objectives;  describes  the  criterion  or  standard  of  per- 
formance which  must  be  attained. 


STIMULUS  CRITERIA:  Those  basic  qualities  or  capabilities  of  a 

medium  that  are  required  to  carry  out  the  Intent  of  the 
learning  activity;  for  example,  visual  images,  motion, 
color,  and  sound. 


STORYBOARD:  A collection  or  series  of  small  pictures  which  describe 
the  action  and  content  that  will  be  contained  in  an  audio 
visual  or  visual-only  production.  A sequence  of  these 
small  pictures  comprise  a storyboard. 


SUBJECT  MATTER  EXPERT:  A person  who  has  professional  skill  In  the 
performance  of  some  job  and  who  Is  consulted  by  an  In- 
structional designer  In  the  process  of  job  task  analysis. 


SUPPORTIVE  RELATIONSHIP:  Occurs  when  skills  and  knowledges  In  one 
objective  have  some  relationship  to  those  In  the  other 
objective;  the  learning  Involved  In  mastery  of  one  learn- 
ing objective  transfers  to  the  other,  making  learning 
Involved  in  the  mastery  of  the  other  easier. 
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SYMBOL;  Anything  that  stands  for  or  represents  something  else.  A 
plus  sign  (+)  is  a s^mibol  for  the  mathematical  operation 
of  addition. 


SYSTEM  MASTER  PLAN:  Control  document  used  to  coordinate  the  develop- 
ment and  implementation  of  an  instructional  program. 


SYNCHRONIZING  PULSE:  An  audible  or  inaudible  sound  used  to  coordinate 
the  audio  and  video  portions  of  a slide-tape  program  so 
that  audio  and  video  (i.e.,  slide  and  narration)  are 
coordinated. 


SYSTEMS  APPROACH:  A generic  term  referring  to  the  orderly  process  of 

analysis,  design,  development,  evaluation,  revision,  and 
operation  of  a collection  of  interrelated  elements. 


TALK-THROUjH  TECHNIQUE:  Occurs  during  the  simulation  of  an  operational 
system;  involves  talking  through  each  operation  in  the 
new  system  to  determine  decisions  and  contingencies. 


TARGET  POPULATION:  The  pool  of  potential  entrants  to  training  for 

which  instructional  materials  are  designed  and  tried  out. 


TASK  DELAY  TOLERANCE:  A measure  of  how  much  delay  can  be  tolerated 
between  the  time  the  need  for  task  performance  becomes 
evident  and  the  time  actual  performance  must  begin. 


TASK;  Formed  in  clusters  which  make  up  duties.  A task  is  the  lowest 
level  of  behavior  in  a job  that  describes  the  performance 
of  a meaningful  function  in  the  job  under  consideration. 


TASK  INVENTORY:  LisL  that  itemizes  all  of  the  tasks  that  make  up 

a selected  duty. 


TASK  LEARNING  DIFFICULTY;  Refers  to  time,  effort,  and  assistance  re- 
quired by  a student  to  achieve  performance  proficiency. 


TASK  STANDARD:  A statement  of  how  well  a task  must  be  performed. 


A 
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TASK  STATEMENT:  A statement  of  highly  specific  action  which  has  a 
verb  and  object;  for  example,  sort  mail. 


TECHNICAL  ORDERS:  Military  regulations  which  deal  with  the  specific 
nature  of  technical  materials  and  equipment. 


TERMINAL  LEARNING  OBJECTIVE:  Derived  from  job  performance  measures, 

TLOs  are  to  be  attained  during  training.  TLOs  are  broken 
down  into  their  component  parts  which  are  documented  as 
learning  objectives  which  may  be  further  divided  into 
learning  steps.  Each  TLO  contains  actions,  conditions, 
and'  standards. 


TESTS:  Any  device  or  technique  used  to  measure  the  performance  of  a 
student  on  a specific  task  or  subject  matter. 

TESTING  CONSTRAINTS:  Limitations  such  as  time,  money,  personnel,  | 

facilities,  and  other  resources,  which  prohibit  job  I 

performance  measures  from  being  identical  to  the  tasks  | 

they  measure.  1 


TRADE -Of-'FS:  In  any  systematic  approach  to  instruction,  it  is 

necessary  to  make  compromises  between  what  is  desirable 
and  what  is  possible.  Ordinarily,  these  decisions  in- 
volve increases  or  decreases  in  time,  money,  facilities, 
equipment,  or  personnel.  Training  aids  and  simulators 
represent  examples  of  trade-offs. 


TRAINER  APPRAISAL  KIT;  A package  of  instructional  materials 
designed  to  provide  a course  instructor  with 
practice  in  the  preparation,  presentation,  and  valida- 
tion of  instruction. 


TRAINING:  The  teaching  of  job  skills.  It  can  take  a number  of  forms 
such  as  seif-teaching  exportable  packages,  training 
manuals,  individual  learning  packages,  FOJT,  or  group 
training. 


TRAINING  SETTING  CRITERIA:  In  media  selection,  the  options  that 

training  must  be  either  small  group,  large  group,  indi- 
vidualized ac  a fixed  location,  or  individualized  inde- 
pendent of  location. 
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TRYOUT:  Practice  test;  the  purpose  is  to  make  the  tryout  as  realistic 
as  possible  by  eliminating  as  many  sources  of  unreliability 
as  possible. 


UNDERTRAIN:  Provide  inadequate  training  that  does  not  prepare  a 
studont  to  meet  regular  job  performance  requirements. 


VALIDATION:  A process  through  which  a course  is  revised  until  it 
is  effective  in  realizing  its  instructional  goal. 


VALIDATION  DOCUMENTATION:  A report  which  describes  in  detail  how 
a specific  course  of  instruction  was  validated  and  fur 
what  target  population. 


VALIDATION  PROCESS:  Testing  instructional  materials  on  a sample  of 
the  target  population  to  insure  thac  the  materials  are 
effective. 


VALIDITY:  The  degree  to  which  a test  measures  what  it  claims  to 
measure. 


VALUE  ENGINEERING:  Refers  to  the  process  of  designing  equipment 

or  instruction  to  meet  but  not  exceed  the  required  out- 
comes. Ordinarily,  it  refers  to  the  elimination  of 
features  or  instructional  objectives  that  have  not  been 
demonstrated  to  be  positively  necessary. 


VIGILANCE  LEVEL:  Gene**al  degree  of  watchfulness  or  attentiveness 
to  what  ma..  come. 


VISUAL  FORM:  In  media  selection,  refers  to  whether  alphanumeric  or 

pictorial  characteristics  are  required  in  a learning 
situation. 


VISUAL  SPECTRUM:  The  type  of  color  required  of  instructional 

materials.  Some  must  be  with  full  color,  others  may 
be  with  black  and  white  or  shades  of  grey. 


WITHIN-COURSE  TESTS:  Administered  during  a course  of  instruction 

to  assure  that  all  students  are  “keeping  up"  with  the 
learning  objectives. 


INDEX 


NOTE:  The  Roman  numerals  following  each  entry  refer  to  the  Phase 
numbers;  the  Arabic  numerals  refer  to  the  page  numbers. 


Ability  grouping.  Ill:  125 
Achievement  grouping.  Ill:  125 
Activities,  see  Learning  activities 
Adjunct  programs.  Ill:  251 
Affective  component:  attitude 
learning.  III:  66-67,  103 
Air  Force  Specialties  (AFS),  I:  3,8 
Algorithms.  Ill:  20-22.  71-104 
Antisubmarine  warfare  (ASW) 

training  program.  Navy,  III:  142 
Attitude  learning:  learning  sub- 
category  11,  III:  66-70,  103-104 
affective  component.  III:  66-67, 
103 

behavioral  component.  III:  66, 
70.  104 

cognitive  component.  III:  66, 
67-70,  104 

Audio  producer  (production  person- 
nel), III:  228 

Audio-visual  p~'''^uct1on.  III:  235- 
244 


Baseline  data  collection,  V:  25-26, 
70-71 

Behavioral  component:  attitude 
learning.  III:  66,  70,  104 
Block  scheduling  (group  instruc- 
tion plan).  III:  124-125 


Classifying:  learning  sub- 
category 2,  III:  38-40,  74-75 
Clustering,  task,  I:  244-245 
Cognitive  component:  attitude 
learning.  III:  66,  67-70,  104 
Command  Job  Analysis,  schedule  for, 
I:  58 

Conmon-factor  learning  objectives, 
II:  90-92 

Comprehensive  Occupational  Data 
Analysis  Program  (CODAP), 

I:  121 


Computer-assisted  instruction  (CAI), 
III:  191 

Computer-managed  Instruction,  III: 
191-194 

Conditions.  JPM,  I:  177-178 

on-the-job,  task,  I:  24-26,  89-93 
Contiguity,  III:  41 
Contingency-managed  Instruction, 

III:  187-189,  215 

Contract,  student  (or  perf ormance) , 
III:  189 

Cues.  JPM,  I:  179 

prompts  for  student  learning,  III: 
6-8 

task,  I:  25,  27-28 


Data  collection, 

for  external  evaluation.  V:  68-77 
for  internal  evaluation,  V:  1-8, 
29-46,  53-62 
for  JPMs,  1:45-46 
for  rating  tasks,  I:  133-139 
Data  collection  plan  for  job  analysis, 
alternate  or  short-cut,  I;  47, 

77-78 

form  preparation,  I:  49-51,  59 
group  interviews,  I:  40 
Individual  and  observation  inter- 
views, I:  36-37,  41-46,  52-62 
jury-of-cxperts , I:  39-40 
questionnaire  survey,  I:  37-39, 

45,  46,  68-73 

Decision-making:  learning  sub-category 
5,  III:  46-48,  83-86 
Decisions,  management.  Executive 
Summary:  20,  24-25,  30-32,  36-37. 
42-43,  61 , 54-55,  59,  63,  69-70, 
75-76,  81-82,  85-86,  91-92,  96-97. 
100-101,  108-109,  114-115,  119-120 
Decision  trees,  see  Algorithms 
Defense  Occupational  Specialties  (DOS), 
I:  3,  8,  214 

Delay  tolerance,  see  Task  delay  ... 
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Delivery  system,  III:  213-214, 
see  also  Media  and  Instructional 
management  plan  and  delivery 
system 

Detecting:  learning  sub-category  4, 
III:  43-45,  78-82 
Duty,  I:  11-12 


Electronic  technician  (productior 
personnel).  III:  229 
Element(s),  I:  17-22 

alternate- path,  I:  22-24 
fixed-sequence,  I:  22-24 
Entry  behavior,  student,  II:  62-77 
definition  of,  II:  62-53 
entry  tests  for,  II:  70-72 
outputs,  II:  76 

procedures  for  determining,  II: 
64-75 

purpose  of  establishing,  II: 
62-63 

pretesting,  II:  62,  73-75 
remedial  or  preparatory 
instruction,  II:  69 
revise/ test  procedure,  II:  69 
tests  to  verify  assumptions 
about,  II:  63-69 

Entry  test,  development  of,  II:  72 
need  for,  II:  70-72 
Equipment-oriented  jobs,  I:  81-83 
Errors  in  measuring  and  testing, 

I:  201-205;  IV:  33 
of  halo,  I:  203-204;  IV:  33 
of  logic,  I:  204-205 
of  standard.  I:  202;  IV:  33 
Evaluation,  external,  see  External 
evaluation 

Evaluation,  internal,  see  Internal 
evaluation 

Existing  courses,  analysis  of,  I: 
213-229 

development  documentation  for, 

I:  220 

evaluating  existing  job  analy- 
ses for,  I:  215-216,  221-222 
evaluating  existing  Job  Perform- 
ance Measures  for,  I:  216, 
225-226 

evaluating  tasks,  I:  223-224 
evaluating  validation  documen- 
tation for,  I:  226 
Front  End  Analysis,  I:  216-218 


Existing  courses  (continued) 
outputs,  I:  218,  227-^?S 
procedures  for,  I:  218-227 
rationale  for,  I:  213,  215 
revisions  indicated  by,  I:  227 
Existing  materials,  review  of.  III: 
198-220 

collection  process  for.  III: 

202-203 

modifications  determined  by.  III: 
206-208,  212-213,  216 
outputs.  III:  216-217 
procedures  for.  III:  201-216 
rationale  for.  III:  198-201 
with  reference  to  delivery  system, 
III:  213-214 

with  reference  to  learner  charac- 
teristics. Ill:  203-205 
with  reference  to  learning  guide- 
lines, 111:  208-213 
with  reference  to  management  plan, 
III:  214-215 

External  evaluation,  V:  63-86 

baseline  data  collection,  V:  70-71 
data  collection  methods,  V:  68-69 
data  collection  procedures,  V:  69- 
77 

data  consolidation,  V:  78-81 
data  requirements,  V:  66-68 
data  sources,  V:  65-66 
documentation,  V:  84-85 
job  performance  evaluation  data 
collection,  V:  71-73 
outputs,  V:  83-85 
personal  interview  data,  V:  74-75 
planning  phase,  V:  65-69 
procedures,  V:  65-83 
purposes  of,  V:  63-65 
questionnaire  use,  V:  73-74 
recommendations,  V:  81-83 
records  of  students'  performance 
during  instruction,  V:  76-77 
report  (EXER),  V:  78,  83 
time  considerations,  V:  68 
External  Evaluation  Report  (EXER),  V: 
78.  83,  90-91,  93,  95-96,  105,  109- 
110,  112 


Feedback.  Ill:  6,  9-10 
Formal  On-the-Job  Training  (FOOT),  I: 
231,  237-238,  256-258;  III:  139- 
141,  260-262 
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Delivery  systta.  Ill:  213-214. 
stt  also  NedU  and  Instructional 
AuiageiMmt  plan  and  dtlivery 
systea 

Oetacting;  learning  sub-category  4. 

Ill:  43-45,  78-82 
Duty.  I:  11-12 


Electronic  technician  (production 
personnel).  III:  229 
E1eaient(s}.  I:  17-22 

a1temate-pa,th.  I:  22-24 
fixed-sequence,  I:  22-24 
Entry  behavior,  student,  II:  62-77 
definition  of,  II:  62-63 
entry  tests  for,  II:  70-72 
outputs,  II:  76 

procedures  for  detemining,  II: 
64-75 

purpose  of  establishing,  II: 
62-63 

pretesting,  II:  62,  73-75 
remedial  or  preparatory 
instruction,  II:  69 
revise/test  procedure,  II:  69 
tests  to  verify  assumptions 
about,  II:  63-69 

Entry  test,  development  of,  II:  72 
need  for,  II:  70-72 
Equipment-oriented  jobs,  I:  81-83 
Errors  in  measuring  and  testing, 

I:  201-205;  IV:  33 
of  halo,  I:  203-204;  IV:  33 
of  logic,  I:  204-205 
of  standard,  I:  202;  IV:  33 
Evaluation,  external,  see  External 
evaluation 

Evaluation,  internal,  see  Internal 
evaluation 

Existing  courses,  analysis  of,  I: 
213-229 

development  documentation  for, 

I:  220 

evaluating  existing  job  analy- 
ses for,  I:  215-216,  221-222 
evaluating  existing  Job  Perform- 
ance Measures  for,  I:  216, 
225-226 

evaluating  tasks,  I:  223-224 
evaluating  validation  documen- 
tation for,  I:  226 
Front  End  Analysis,  I:  216-218 


Existing  courses  (continued) 
outputs,  I:  2187727^ 
procedures  for,  I:  218-227 
rationale  for.  I:  213,  215 
revisions  Indicated  by,  I:  227 
Existing  materials,  review  of,  III: 
198-220 

collection  process  for.  III: 

202-203 

modifications  determined  by.  III: 
206-208,  212-213,  216 
outputs,  III:  216-217 
procedures  for.  III:  201-216 
rationale  for.  111:  198-201 
with  reference  to  delivery  system, 
III:  213-214 

with  reference  to  learner  charac- 
teristics, III:  203-205 
with  reference  to  learning  guide- 
lines, III:  208-213 
with  reference  to  managetnent  plan, 
III:  214-216 

External  evaluation,  V:  63-86 

baseline  data  collection,  V:  70-71 
data  collection  methods,  V:  68-6C 
data  collection  procedures,  V;  gg- 
77 

data  consolidation,  V;  78-81 
data  requirements,  V:  66-68 
data  sources,  V:  65-66 
documentation,  V:  84-85 
job  performance  evaluation  data 
collection,  V:  71-73 
outputs,  V:  83-85 
personal  interview  data,  V:  74-75 
planning  phase,  V:  65-69 
procedures,  V:  65-83 
purposes  of,  V:  63-65 
questionnaire  use,  V:  73-74 
recommendations,  V:  81-83 
records  of  students'  performance 
during  instruction,  V:  76-77 
report  (EXER),  V:  78,  83 
time  considerations,  V:  68 
External  Evaluation  Report  (EXER),  V: 
78,  83,  90-91,  93,  95-96,  105,  109- 

no,  112 


Feedback,  III:  6.  9-10 
Formal  On-the-Job  Training  (FOJT),  I: 
231,  237-238,  256-258;  III:  139- 
141,  260-262 
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Instructional  Management  plan.  Imple- 
Mentation  of.  IV:  1-16 
equipMent,  IV:  IS 
Instructor's  manual,  reviewed 
and  supplemented,  IV:  4-5 
materials.  IV:  IS 
procedures.  IV:  4-15 
space  allocation,  IV:  14-15 
staff  training,  IV:  7-12 
*itudent  selection,  IV:  13 
student  manuals,  reviewed  and 
supplemented,  IV:  6 
time  allocation.  IV:  14 
time  relationships  within  ISO 
process.  IV:  3-4 
Trainer  Appraisal  Kit  (TAK). 

IV:  7-12 

Instructional  materials,  validation 
of.  III:  280-346 
attitude  measures.  III:  288, 

294-295 

data  analysis  plan.  III:  295-297, 

316 

data  collection  and  recording 
system.  III:  287-293,  314-316 
data  consolidating  and  analyzing, 
III:  304-308.  331 
group  trial,  administering.  III: 

328 

group  trial  procedures.  III:  316- 

317 

individual  trials,  plan  for  con- 
ducting Instruction  for.  III: 
297-298 

Individual  trials,  steps  in  con- 
ducting. Ill:  298-303 
learning  objective  rating.  III: 
317-327 

nature  and  purpose  of.  III:  280- 
285 

outputs,  III:  336-339 
participant  selection  for  group 
trials.  III;  317,  328 
plan  for  group  trials.  III:  312- 
328 

plan  for  Individual  trials.  III; 
285-298 

platform  instruction.  III:  329- 
331 

procedures.  III:  205-336 
revision  of  attitude  measures, 

III:  316 


Instructional  materials,  validation 
of,  (continued) 

revision' requfrei^ts,  III:  308- 
311,  332-336 

standards  and  constraints  for 
group  trials.  III:  313-314 
Instructional  methods  and  devices, 

III:  163-172 

audio-only  systems.  III:  163 
audio-visual  systems.  III:  163-166 
computer  simulation,  HI:  166-168 
print  materials.  III:  169-171 
special  and  non-standard  Items, 

III:  171-172 

visual-only  systems.  III:  168-169 
Instructional  settlng(s),  selection 
of.  I:  230-264 

assignment  of  tasks,  I:  233-263 
clustering  tasks,  I:  244-245 
cost  analysis  for,  I:  240-242 
definition  of  instructional 
setting,  I:  230-231 
documentation  for,  I:  262-263 
Formal  On-the-Job  Training  (FOJT), 

I:  231,  237-238,  256-258 
group  training,  I:  239 
Inputs,  I:  231-232 
Installation  Support  Schools  (ISS), 
I:  231,  238,  258-259 
Job  Performance  Aids  (JPAs),  I; 

231,  233-235,  236,  242,  245-249 
Job  Performance  Measures  in,  I: 

232 

outputs,  I:  262-263 
personnel  data  factor  in,  I;  249- 
250 

procedures,  I:  242-263 
Resident  Schools  (RS),  I:  231,  238- 
239,  259 

revision  of  task  assignments,  I: 
260-262 

Self-Teaching  Exportable  Packages 
(steps),  I:  231,  235,  237,  250- 
255 

work  experience,  I:  239-240 
Instructional  Systems  Development  (ISO) 
program,  documentation  for,  I: 
83-84,  87 

initiation  of,  I:  1-5 
purpose  of,  I:  2,  214 
rationale  for  sequence  of,  I:  5-6 
Instructional  television  (ITV),  III: 
194-195 
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Instructional  nanagtinont  plan.  Imple- 
■lintatlon  of,  IV:  1-18 
equipment,  IV:  15 
Instructor's  manual,  reviewed 
and  suppi  alien  ted,  IV:  4-5 
materials,  IV:  15 
procedures,  IV:  4-15 
space  allocation,  IV:  14-15 
staff  training,  IV:  7-12 
student  selection,  IV:  13 
student  manuals,  reviewed  and 
) supplemented,  IV:  6 

time  allocation,  IV:  14 
time  relationships  within  ISO 
process,  IV:  3-4 
Trainer  Appraisal  Kit  (TAK), 

IV;  7-12 

Instructional  materials,  validation 
I of,  III:  280-346 

attitude  measures.  III:  288, 

I 294-295 

y data  analysis  plan,  III:  295-297, 

k 316 

I data  collection  and  recording 

\ syston.  III:  287-293,  314-316 

I data  consolidating  and  analyzing, 

III:  304-308,  331 
group  trial,  administering.  III: 
328 

group  trial  procedures.  III:  316- 
317 

Individual  trials,  plan  for  con- 
ducting Instruction  for.  III: 
297-298 

Individual  trials,  steps  in  con- 
ducting, III:  298-303 
learning  objective  rating.  III: 
317-327 

nature  and  purpose  of,  III:  280- 
285 

outputs.  III:  336-339 
participant  selection  for  group 
trials.  III:  317,  328 
plan  for  group  trials.  III:  312- 
328 

plan  for  Individual  trials.  III: 
285-298 

platform  Instruction,  III:  329- 
331 

procedures.  III:  285-336 
revision  of  attitude  measures, 

III:  316 


Instructional  materials,  validation 
of,  (continued) 

revision  requlremmts.  III:  308- 
311,  332-336 

standards  and  constraints  for 
group  trials.  Ill:  313-314 
Instructional  methods  and  devices, 

III:  163-172 

audio-only  systems.  III:  163 
audio-visual  systems.  III:  163-166 
computer  simulation,  HI:  166-168 
print  materials.  III:  169-171 
special  and  non-standard  1t^, 

III:  171-172 

visual-only  systems,  III:  168-169 
Instructional  settlng(s),  selection 
of,  I:  230-264 

assignment  of  tasks,  I:  233-263 
clustering  tasks,  I:  244-245 
cost  analysis  for,  I:  240-242 
definition  of  instructional  i 

setting,  I:  230-231  ‘ 

documentation  for,  I:  262-263 
Formal  On-the-Job  Training  (FOJT), 

1:  231,  237-238,  256-258 
group  training,  I:  239 
Inputs,  I:  231-232 
Installation  Support  Schools  (ISS), 

I:  231,  238,  258-259 
Job  Performance  Aids  (JPAs),  I: 

231,  233-235,  236,  242,  245-249 
Job  Performance  Measures  In,  I: 

232 

outputs,  I:  262-263 
personnel  data  factor  In,  I:  243- 
250 

procedures,  I;  242-263 
Resident  Schools  (RS),  I:  231,  238- 
239,  259 

revision  of  task  assignments,  I: 

260-262 

Self-Teaching  Exportable  Packages 
(steps),  I:  231,  235,  237,  250- 
255 

work  experience,  I:  239-240 
Instructional  Systems  Development  (ISO) 
program,  documentation  for,  I: 

83-84,  87 

initiation  of,  I:  1-5 
purpose  of,  I:  2,  214 
rationale  for  sequence  of,  I:  5-6 
Instructional  television  (ITV),  III: 

194-195 
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Job  PerforMif^t  Hcasures  (con- 
tinued) 

In  selMtIng  instructional 
settings.  I:  232,  242 
In  system  revision,  V:  110-111 
in  testing,  II:  44 
Job  Performance  Measures,  con- 
struction of,  I:  156-212 
checklists  for,  I:  196-197,  211 
conditions,  I:  177-178 
cues,  I:  179 

cut-off  scores  for,  I:  200-201 
data  collection  for,  I:  45,  46 
documentation  for,  1:  191-193, 
209 

errors  in  measurement.  I:  201- 
205 

outputs.  I:  209 
part- task  testing,  I:  185-187 
physical  fidelity,  I:  161-163, 
167 

predictive  validity,  I:  158-161, 
167 

procedures  for,  I:  165-209 
process  and  product  rating,  I: 
170-171,  195-196 
rationale  for,  I:  156-157 
rating  scales  for,  I:  197-200 
sample  list  of  validated  JPMs, 

1:  210 

sampling  plan,  I;  187-191 
scoring  procedures,  I:  191, 
194-204 

simulator  requirements  for,  I: 
163,  172-176 
standards,  I:  180-184 
testing  constraints,  I:  166- 
170 

tryout  procedure,  I:  207-208 
types  of  tasks  measured,  I: 
164-165 

validation  and  revision,  I: 
205-209 

Job  Performance  Test  (JPT),  I:  158 
Jury-of-Experts,  I:  39-40,  41,  67 


Knowledge  of  results  (KOR),  III; 
31,  32,  33,  48,  51 


Learning  activities,  see  Learning 
even ts/ac ti  v i ti ts , s pec  i fy i ng 


Learning  analysis,  II:  18-30 
attitude  category,  II:  28-30 
Information  category,  II:  23-26 
mental  skills  category,  II:  19-23 
physical  skills  category,  II:  26- 
28 

Learning  categories  and  sub-categories, 
II:  16-17,  III:  11-17 
Learning  events/activities,  specifying, 
III;  1-105 

classification  of  learning 
objectives.  III:  10-17 
conditions  (active  vs.  passive), 

III:  4-5 

cues  or  prompts.  Ill:  6-8 
directions  for.  III:  24-26 
feedback.  III:  6.  9-10 
flowcharts  (algorithms).  III:  18, 

20,  71-104 

guidelines  for  eleven  sub- 
categories of  learning,  HI: 
17-18,  35-70 

learning  categories  with  sub- 
categories, III:  11-17 
learning  guidelines  (general).  111: 
3-6 

outputs.  111:  26 
procedures.  III:  3-26 
purposes.  III:  1-3 
Learning  guidelines,  functions  of, 

III:  1-4,  208-213 
general,  HI:  3-6,  10 
specific,  for  eleven  learning 
sub-categories,  IH:  17-20, 

35-70 

sub-category  1:  rule-learning  and 
using,  IH:  35-37,  71-73 
sub-category  2:  classifying,  HI: 
38-40,  74-75 

sub-category  3;  identifying  symbols, 
HI:  41-42,  76-77 
sub-category  4:  detecting,  HI: 
43-45,  78-82 

sub-category  5:  making  decisions, 
III:  46-48,  83-86 

sub-category  6:  recalling  bodies  of 
knowledge.  III:  49-52.  87-90 
sub-category  7:  performing  gross 
motor  skills.  III:  53-55,  91-93 
sub-category  8:  steering  and  guid- 
ing, III:  56-57,  94-95 
sub-category  9:  positioning  move- 
ment, III;  58-62,  96-99 
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Learning  guidelines  (continued) 
sub-category  10:  vo1c¥  counMnl- 
catlng.  Ill:  63-65,  100-102 
sub-category  11:  attitude 
learning.  III:  66-70,  103- 
104 

Learning  objectives  (LO).  II:  1, 

4-5,  8-30,  see  also  Objectives, 
conwon-f actor,  II:  90-92 
testing,  II:  36,  38,  39,  42-45, 
49-50,  64 

Learning  Objective  Analysis  Work- 
sheet, II:  7;  III:  27,  109,  224- 
225 

Learning  objectives,  sequencing  and 
structuring,  see  Sequence  and 
structure  of  Teaming  objectives, 
determining 

Learning  Resource  Centers  (LRCs), 
III:  141 

Learning  steps  (LSs),  II:  4.  5,  36, 
38,  57 


Management  decisions,  see  Decisions, 
management 

Management  guidelines,  III:  124-137 
Management  plan,  s^  Instructional 
management  plan  and  delivery 
system 

Management  plans,  student.  III:  185- 
196 

combination  plans.  III:  196 
computer-managed  instruction, 

III:  191-194 

contingency-managed  instruction, 
III:  187-189 

instructor-managed  instruction, 
III:  186-187 

media-managed  instruction.  III: 
194 

peer-managed  instruction.  III: 
190-191 

student  self-managed  instruction, 
III:  195 

Marginal  students,  guidelines  for 
managing.  III:  129-130 
Materials,  existing— review  of, 
see  Existing  materials,  review  of 
MatrfFes  (for  media  selection).  III: 
113,  115-118,  172-184 
Media,  comparative  costs.  III:  112 


Media  (continued) 

decisTorTiiiFices  for  selection 
of.  III:  172-184 
evaluation  of,  see  Existing 
materials,  review  of 
revision,  III:  206-208 
selection  (for  instructional 
managmnent  plan).  III:  106- 
124,  172-184 

Media-managed  instruction.  III:  194 

Media  specialist  (oroduction  person- 
nel), III:  227 

Military  Occupational  Specialties 
(MOS),  I:  3.  8 

Misclassifications,  in  testing,  II: 
52-55 

Mnemonics,  III:  31,  36.  41,  50,  59 


Non-equipment-oriented  jobs,  I:  79 
81 


Objectives,  development  of,  II;  1- 

34 

action  statement,  II;  5-12 
conditions  statement,  II;  5-6, 
9-10,  13-14 

criteria  for  Terminal  Learning 
Objective  and  Learning  Objec- 
tive statements,  II;  8-16 
inputs,  II:  1-2 

Job  Performance  Measures  in,  II; 
2 

learning  analysis  for  each  Term- 
inal Learning  Objective,  II: 
18-30 

learning  analysis:  attitude 
category,  II;  28-30 
learning  analysis:  information 
category,  II:  23-26 
learning  analysis:  mental  skills 
category,  II:  19-23 
learning  analysis:  physical 
skills  category,  II:  26-28 
learning  categories,  II:  16-17 
learning  objectives  (LOs),  II: 
4-5,  8-30 

learning  steps  (LSs),  II:  4-5 
outputs,  II:  30 
procedures,  II;  6-30 
standards  statement,  II:  5-6, 
9-10,  14-16 
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Objectives,  development  of  (con- 

tWmihel  learning  objectives 
(TLOs)  preparation,  II:  2-S, 
6-16 


Peer-managed  Instruction,  III:  190- 
191,  215 

Perceptual  set(s).  III:  46,  63 
Performance  Evaluation  Plan,  V:  22- 
28 

area  of  "entry  skills,"  V:  24- 
25 

area  of  "external  requirements," 
V:  23-24 

area  of  "tests,"  V:  25-26 
area  of  "time  required  to  com- 
plete instructional  units," 

V:  27-28 

Performing  gross  motor  skills: 
learning  sub-category  7,  III: 
53-55,  91-93 

Photographer  (production  personnel), 
III:  228 

Physical  fidelity,  of  Job  Perform- 
ance Measures,  I:  161-163,  167 
Platform  lectures.  III:  248 
Positioning  movement  and  recalling 
procedures:  learning  sub-category 
9,  III:  58-62,  96-99 
Post-feedback  delay.  III:  61 
Posttest,  V:  109-110 
Predictive  validity  of  Job  Per- 
formance Measures,  I:  158-161, 

167 

Predifferentiation  of  stimuli.  III: 
38,  41 , 49 
Pretest,  II:  73-75 
Print  specialist  (production  per- 
sonnel ) , III:  228 
Process  Evaluation  Plan,  V:  14-22 
Process  rating,  I:  196 
Product  rating,  I:  195 
Program  Evaluation  Review  Tech- 
nique (PERT),  V:  10 
Programmed  instruction.  III:  246- 
247 

Progress  Evaluation  Plan,  V:  11-14 


Questionnaire  survey,  administra- 
tion of.  I:  72-73,  106-112 


Questionnaire  survey  (continued) 
closed  form.  I:  38-2^ 
for  external  evaluation  data 
collection,  V:  73-74 
for  job  analysis,  T:  37-39,  44- 
46 

for  rating  tasku  for  training, 
I:  133-136 
open  form,  I:  38-39 
preparation  of,  I:  68-71,  134- 
136 

sample  selection  for,  I:  71-72, 
133-134 


Random  grouping,  'II:  125 
Rank-order  testing,  II:  52-55 
Ratings  (Navy),  I:  3,  8 
Rating  scales  (for  Job  Performance 
Measures),  description  of,  I: 
197-198 

graphic,  I:  198-200 
numerical,  I:  197 
Recalling  bodies  of  knowledge: 
learning  sub-cateyory  6,  III: 
49-52,  87-90 

Reinforcement;  reinforcer.  III: 
187-189 

Resident  Schools  (RS),  I:  238- 
239,  259;  III:  139-141 
Response  biases,  III:  46 
Revision  of  system,  see  System 
revision 

Revision  plan  format,  V:  113 
Rule-learning  and  using:  learning 
sub-category  1,  III;  35-37,  71-73 


Sampling  plan  for  Job  Performance 
Measures,  I:  187-191 
Self-pacing  instructional  plan.  III: 
124,  125-126 

Self-Teaching  Exportable  Packages 
(steps),  I:  231,  235-237,  250- 
255;  III:  140-142,  248-249 
Sequence  and  structure  of  learning 
objectives,  determing,  II:  79-96 
common-factor  learning  objectives, 
II:  90-92 

determining  relationships,  II: 
81-82,  83 

grouping,  II:  92-94 
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SequeiKC  and  structure  of  learning 
objectives,  determining  Contin- 
ued) 

MrE^ts,  II:  94 
procedures.  11:  81-93 
purposes  of,  II:  79-80,  88-89 
with  dependent  relationships, 

II:  82-87 

Mitb  Independent  relationships. 
II:  90 

with  supportive  relationships. 
II:  87-88 

Setting,  see  Instructional  set- 
ting, seTection  of 
Shaping.  Ill:  65,  57 
Simulator  requirements  in  Job 
Performance  Measures,  I;  163, 
172-176 

Slide- tape  production.  III:  23S- 

244 

Soft  data,  V:  4 

Source  materials,  of  job  analysis 
data  and  job  information,  I: 
97-98 

of  training  courses  and  In- 
structional materials,  I: 
95-97 

Staff  training.  Instructional . 

IV:  7-12 

Standards.  Job  Perfomance 
Measures,  I:  180-184 
task,  I:  28-33 
terminal  learning  objective 
test.  II:  47-50 
training,  II:  47-50 
State-of-the-art,  III:  120 
Steering  and  guiding:  learning 
sub-category  8,  III:  56-57, 

94-95 

Stimulus  criteria  (media),  III: 
107-108 

Storyboards,  III:  234,  239-242, 
245-246 

Student  management  plans,  see 
Management  plans,  student  and 
Instructional  management  plan 
Student  self-managed  Instruction. 

Ill:  195,  215 
Students'  Guide,  III:  269 
Students'  manual,  IV:  6 
Subject  Matter  Experts  (SMEs), 

I:  79,  81-82,  133 


Supplementary  Instruction,  III:  249- 
250 

System  Master  Plan  (91P),  III:  1C5. 

107,  138-142;  V:  10,  50-91 
Systme  revision,  V;  87-120 

based  on  changes  In  doctrine  or 
content  of  DOS,  V:  94 
based  on  efficiency  of  Instruc- 
tion, V:  96-103 
based  on  External  Evaluation 
Report.  V:  95-96 
based  on  Internal  Evaluntlon 
Report,  V:  95 
description  of,  V:  87-89 
follow-up  activity,  V:  115 
for  Improvement  of  Instructional 
effectiveness,  V:  109-112 
for  operating  Instruction,  V: 
105-106 

for  time  reduction.  V;  106-109 
guidelines  for  determining  revi- 
sion needs.  V:  103-112 
outputs,  V:  115-116 
preparation  of  revision  plan, 

V:  112-114 

priority  ratings  for,  V:  92 
procedures  for,  V:  93-115 
purposes  of,  V:  87-90,  93 
sources  for,  V:  90-91 


Task(s),  I:  12 

checklist  task  inventory,  I: 
152-154 

clustering  of,  I:  244-245 
conditions  statement  for,  I:  24- 
26.  89-93 

delay  tolerance,  I:  123-125,  246 
guidelines  for  diagramming,  I: 

24 

Inventory,  verifying  and  validat- 
ing, I:  66-68 

Job  Performance  Measures  for,  I: 
157-211 

multiple,  I:  164-165 
statements,  I:  13-17,  61 
unitary,  I:  164 

validated  task  list,  sample,  I: 
33.  86 

Task  selection,  I:  113-155 

criteria  for,  I:  113-133,  152- 
154 
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Task  selection  (tanttnued) 
data  assessing  and  cfe^clslon- 
waklng  for,  I:  139-148 
data  collection  for,  I:  134-136 
data  consolidation  for.  I;  136- 
139 

managewnt  constraints.  I:  143- 
144 

outputs,  I:  117,  148-149 
procedures,  I:  117-148 
rationale  for,  I:  115-117 
survey  sources.  I:  133-134 
Television  produ<:er  (production 
personnel),  III:  229 
Television  program  production,  HI: 
244 

Terminal  learning  objectives  (TLOs), 
II;  1-31 

action  statement  of.  II:  5-12 
conditions  statement  of,  II:  5-6, 
9-10,  13-14 

guidelines  for  learner.  III;  4 
learning  analysis  for,  II:  18-30 
learning  categories,  II:  16-17 
standards  statement  of,  II:  5-6, 
9-10,  14-16 

Test  development,  II:  35-61 
attitudes  testing,  II:  45-46 
information  testing,  II:  42-44 
inputs,  II:  7 

mental  skills  testing,  II:  39-42 
misclasslfications,  II:  50-52 
outputs,  II;  37,  60 
physical  skills  testing,  II:  44-45 
procedures,  II:  38-60 
purposes , 1 1 : 35 

rank-order  testing,  II:  52-55 
scoring,  II:  55-56 
standards,  il:  47-50 
types  of  tests,  II:  35,  38-39 
Testing  constraints  in  Job  Perform- 
ance Measures,  I:  166-177 
Trainer  Appraisal  Kit  (TAK),  IV: 

7-12 

Trainer  Development  Program  (TRADEP), 
IV:  9 

Trainirjg  Extension  Course  (TEC), 

Amv,  III:  141-142 
Training  programs,  selection  of 
tasks  for,  I:  114-133,  139-148 
Training  task  categories,  sm 
Learning  categories 


Trial  report  (small  group),  example, 
III:  340-345 


Voice  communicating:  learning  sub 
category  10,  III:  63-GS,  100- 
102 


Writer  (production  personnel).  III: 
229 


! 

i 

\ 


I 


1 

I 

‘ 5 

t 

I 


I 


•4^ 


: T Y 


: i r i * D 

tt * »C  A 


■j,r  r H-s  r 


f*«'«  *■ 


REPORT  DOCUMENTATION  PAGE j nr. 


HKAD  INJ.rHt'C TIONS 
FORE  COMIM.KTISr.  FORM 


Wl  MimCR 


2 GOVT  ACC^•-^IC*• 


N/A 


«.  TiTI  C f«»trf  5.,Ffl(l»; 

Interservice  Procedures  for  Instructional  Svstras 
Developir.ent;  Executive  Surrary,  Phase  T,  Phase  II 
Phase  III,  Phase  IV,  and  Phase  V. 


J.  AvTMnwf#* 

Robert  K.  Branson,  Call  T.  Rayner,  J.  Lattarr  Cox, 
John  P.  Funan,  F.  J.  King,  Wallace  H.  Rannins 


f,  IPC,  nV  QAMINO  t 2 AT  *ON  S A«f  AftiO  *S 

Center  for  Educational  Technology 
Puite  lA,  Tully  Cj-ra 
The  Florida  Syte  University 
T‘ailai^'»gs»»e,  323^6 


II.  COST »OLi.'*ei  orFtcc  namc  aso  »oc«r*» 

President 

US  Arny  Cuebat  Arms  Training  Board 
ATTN:  ATTNC-TB-TD-TA 

Fort  Bennine.  CA 31905- 


U.  woNiToaiMa  AOCMCV  namc  a Aooaetv"* '<«■  Canmiiint  owf) 


3 cTpiEn  T 'S  n AT  ALOG  NUWBER 


i "type  OE  »t  POST  A PEPlOO  COVERED 

FINAL  - 25  June  1973  - 
31  December  1975 


6 owe.  PCPOPT  NUMBCP 


r“cONTRACT  OR  CRAWT  NUMBERfO 

N61339-73-C-0150 


10.  program  ELEMEN  I.  PROJECT,  TASK 
AREA  • WORK  writ  numbers 

Task  V:  Training  Program 

for  Implementation  of  Empir- 
ically Developed  Instruction 

Tir~RCPORT  OATS 

1 August  1975 

TT  number  or  RAoet 

3/^ 


IS.  security  Class.  f*»  iw»  t»pott) 

UNCLASSIFIED 

7sV'  oeCL assieicaticn'oo«noraoin6 

schedule 

_ N/A 


If.  DISTRIBUTION  STATEMENT  (•!  thit  M*port) 

This  document  has  been  approved  for  public  release  and  sale;  its  distribution 
is  unlimited. 
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IB.  Supplementary  notes 

Prepared  in  corporation  with  the  Tnterservice  Conunittce  for  Instructional 
Systems  Dc-velopment , Dr.  Worth  Sc.nnland,  Chairman. 
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Analyze  Job 

Select  Tasks/Functions 

Construct  Job  Performance  Measures 

Analyze  Existing  Courses 
Select  Instructional  Setting 
Develop  Objectives  


Develop  Tests 
Describe  Entry  Behavior 
Determine  Sequence  & Structure 
Specify  Learning  Events/Activities 
Management  Plan 

Select  Existing  Materials 


20.  ABSTRACT  (^ooffinuo  on  rovoro#  oi'dp  ff  M^raify  by  block  nvo*borJ 

This  report  is  a five  volume  set  of  procedures  developed  for  the  preparation  of 
curriculum  when  Interservice  training  is  called  for.  The  procedures  address 
five  major  phases,  which  are;  analyze,  design,  develop,  implement,  and  control. 
The  procedures  begin  with  methodology  for  conducting  a job  analysis  for  the 
curriculum  subject  area  for  which  the  instruction  is  to  be  developed  and  goes 
through  18  additional  steps  suitable  for  the  empirical  development  of  inter- 
service training. 
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Block  19.  Continued 

r velop  Instruction 
Validate  Instruction 
Implement  Management  Plan 
Conduct  Instruction 


» * 


Internal  Evaluation 
External  Evaliiatlon 
Revise  Syrtem 


